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The  primary  contribution  of  this  research  is  to  ascertain  the 
value  of  macro-economic  variables  to  the  accounting  earnings 
forecasting  process.   In  particular  the  author  posits  the  use  of  an  ex 
ante  causal  modeling  approach  to  earnings  prediction.   Over  the  years 
there  has  been  considerable  research  on  the  nature  of  the  earnings 
process,  especially  its  time-series  properties.   However,  there  are 
unresolved  questions  with  respect  to  both  the  value  of  nonaccounting 
information  in  forecasting  earnings  and  the  probabilistic  nature  of 
earnings  in  general. 

This  study  discusses  many  prediction  issues  as  well  as  conducts 
empirical  work  to  test  the  value  of  a  causal  modeling  approach  to 
earnings  forecasting.   Drawing  from  theory  and  available  empirical 
evidence,  a  regression-based  model  is  developed  to  predict  earnings 
before  extraordinary  items.   An  ex  ante  distributed  lag  with  macro 
(DLWM)  variables  model  is  chosen  because  of  its  ability  to  provide  a 
true  forecast  as  opposed  to  the  "forecast"  of  correlational  regression 


models.  Predictions  of  this  model  and  a  number  of  models  suggested  by 
current  literature  are  obtained  for  a  sample  of  capital  goods,  durable 
goods  and  drug  firms  both  on  an  annual  and  a  quarterly  basis.   The 
models'  forecast  accuracies  are  compared  and  the  results  used  to  help 
establish  the  value  of  macro-economic  variables  to  the  earnings 
prediction  process. 

A  secondary  contribution  is  an  update  of  time-series  model 
prediction  performance.  The  work  presents  comparative  evidence  of  the 
predictability  of  numerous  well-known  models  using  fairly  recent 
prediction  periods.  The  results  indicate  that  the  causal  modeling 
approach  is  a  more  accurate  predictor  of  annual  earnings  before 
extraordinary  items  in  many  industries  studied  and  is  at  least  as 
accurate  in  predicting  quarterly  eaimings  in  the  same  context. 
Box-Jenkins  models  were  found  to  be  no  more  accurate  than  a  DLWM  model 
in  all  industries  at  all  prediction  horizons  tested  above  one  quarter. 
One  quarter  ahead  prediction  did  show  statistically  significant 
superior  performance  of  the  time-series  models,  but  not  always  those 
estimated  using  the  Box- Jenkins  procedure. 

The  findings  demonstrate  the  viability  of  DLWM  methods  in 
combating  the  explosive  nature  of  earnings  predictions  experienced  in 
recent  years. 


CHAPTER  ONE 
INTRODUCTION 


Background  and  Purpose  of  the  Research 
Motivation 

Accounting  earnings  play  a  major  role  in  investment  analysis, 
especially  financial  statement  analysis.   An  investor  considering  a  buy 
or  hold  strategy  regarding  a  particular  stock  is  concerned  with 
evaluating  the  prospects  of  future  stock  price,  among  other  things. 
Information  relating  to  the  overall  economy  and  industry  conditions  is 
relevant  to  his  investment  decision.  Both  earnings  and  security  returns 
are  affected  significantly  by  outside  events.   The  accuracy  of  earnings 
prediction  is  of  interest  to  researchers  for  such  purposes  as  testing 
the  various  models  of  firm  valuation,  the  relationship  between 
unanticipated  earnings  and  stock  prices,  and  the  information  content  of 
disclosures  of  earnings  forecasts  by  management.   The  nature  of  the 
earnings  process  and  the  impact  of  external  events  on  earnings 
forecasts  are  of  direct  interest  to  those  responsible  for  the 
independent  evaluation  of  prediction  disclosures  generated  by  corporate 
management . 

Over  the  years  there  has  been  a  considerable  amount  of  research  on 
the  nature  of  the  earnings  process,  especially  its  time-series 
properties.   However,  there  are  unresolved  questions  with  respect  to 
both  the  value  of  nonaccounting  information  in  forecasting  earnings  and 
the  probabilistic  nature  of  earnings  in  general. 
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In  predicting  earnings,  or  any  other  unknown  future  quantity,  it 
is  important  to  know  the  probability  mechanism  which  underlies  the 
forecast.   Consideration  must  be  given  to  interactions  with  relevant 
factors  that  are  judged  to  be  causal.   Realization  of  a  specific 
earnings  number  is  necessarily  contingent  upon  the  relationship  between 
the  process  of  income  generation  specific  to  the  firm  and  the  influence 
exerted  by  relevant  macro-economic  forces.   The  probabilistic  nature  of 
accounting  earnings  is  apparent  when  one  considers  the  uncertainty 
associated  with  these  major  causal  forces  in  future  periods. 
Earnings  Prediction  Problems 

Problems  of  prior  studies.   The  nature  of  the  results  obtained  in 
prior  studies  does  not  provide  sufficient  information  upon  which  to 
base  judgments  as  to  the  reasonableness  of  forecasts  of  earnings. 
There  still  remains  the  question  of  the  individual  model  which  best 
describes  the  earnings  for  a  particular  industry  or  firm.  With  no 
premier  model  yet  established  as  a  bench  mark  from  which  to  judge  the 
adequacy  of  forecasts  made  by  other  models  or  by  management,  there 
continues  to  be  a  need  for  further  research.   This  is  especially  true 
in  light  of  the  results  of  recent  quarterly  studies  which  indicate  a 
weakness  in  the  Box- Jenkins  (BJ)  methodology  when  applied  to  more 
recent  data  sets.   These  recent  findings  have  created  renewed  interest 
in  methods  for  forecasting  earnings. 

Past  studies  have  attempted  to  validate  and  compare  various 
earnings  predictions  by  using  ex  post  error  measurement,  but 
inconsistent  results  across  industries  and  time  have  made  the 
evaluation  process  a  difficult  one.   The  fact  one  set  of  models  worked 
in  one  time  frame  and  another  set  of  models  performed  better  in  a 
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different  time  frame  means  both  sets  failed  to  consider  fully  the 
probabilistic  nature  of  the  process  generating  the  time  series  of 
earnings  during  the  two  periods.   Therefore,  no  conclusions  can  be 
drawn  concerning  a  global  representation  of  the  properties  of  earnings 
nor  of  the  appropriate  prediction  system. 

Problems  in  evaluating  earnings  forecasts.   Questions  remain  as  to 
the  nature  and  the  extent  of  the  Certified  Public  Accountant's  (CPA) 
review  of  the  forecasting  process.   Current  guidelines  are  very  general 
and  therefore  do  not  provide  a  systematic  procedure  to  follow.  Many  of 
the  CPA's  information  sources  are  left  open  to  judgment  or  to  the 
suggestions  of  future  research. 

Considering  both  the  need  for  future  evidence  and  the  general  lack 
of  bench  marks,  it  is  natural  to  consider  including  nonaccounting 
information  in  the  prediction  process.   However,  previous  research  has 
been  limited  in  establishing  the  value  of  macro-economic  factors  as 
inputs  to  a  forecasting  model.   This  is  especially  true  if  one 
considers  the  need  to  judge  forecasts  at  the  time  they  are  made  (ex 
ante)  as  well  as  subsequent  to  the  actual  earnings  number  being 
realized  (ex  post). 

Research  Contribution 
Influence  of  Macro-economic  Variables 

The  primary  contribution  of  this  research  is  to  ascertain  the 
value  of  macro-economic  variables  to  the  accounting  earnings 
forecasting  process.   Once  established,  the  influence  of  these 
variables  can  be  incorporated  to  express  more  fully  the  probabilistic 
nature  of  accounting  earnings  and  can  be  used  to  evaluate  directly 
management  forecasts,  both  ex  ante  and  ex  post. 
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In  order  to  accomplish  the  goal  of  determining  the  value  of 
macro-economic  factors  (macros,  henceforth),  a  particular  earnings 
prediction  methodology  is  proposed.   This  causal  modeling  approach  uses 
the  economic  variables  to  help  predict  earnings  by  using  a  procedure 
which  allows  specification  of  the  causal  nature  of  the  macros  vis-a-vis 
the  earnings  series. 

There  are  four  reasons  for  developing  this  causal  modeling 
approach.   First,  the  theory  of  the  firm  under  uncertainty  (micro  level 
theory)  is  not  well  developed.   Second,  the  prediction  of  micro  level 
variables  for  subsequent  use  in  ex  ante  forecasting  is  more  difficult 
than  earnings  prediction  itself.   Third,  determining  a  more  complicated 
earnings  structure,  based  on  macro-economic  theory,  is  ill-founded. 
Fourth,  such  a  structure  has  a  high  possibility  of  being  estimation 
period  specific  thereby  reducing  predictive  performance. 

A  compromise  is  developed  which  both  avoids  overfitting  by 
limiting  the  number  of  independent  macro  variables  and  uses  a  versatile 
regression  (very  general  structure)  formulation,  including  the  use  of 
lagged  economic  variables,  to  render  ex  ante  predictions  possible. 
Thus,  the  proposed  major  contribution  would  be  the  evidence  obtained 
from  testing  the  predictability  of  the  causal  model. 
Time-series  Model  Performance  Update 

A  secondary  contribution  of  this  research  is  to  provide  an  update 
of  time-series  models'  prediction  performance.   Well-known  models  are 
compared  to  the  causal  modeling  approach  using  fairly  recent  prediction 
periods.   Therefore,  evidence  is  supplied  relevant  to  the  current 
predictability  of  BJ  time-series  and  non-BJ  time-series  models  as  well 
as  the  causal  models.   The  study  is  capable  of  resolving  some  of  the 
inconsistencies  created  by  past  research. 
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The  two  major  contributions  sought  here  are  (1)  to  assess  the 

value  of  nonaccounting  (macro)  information  in  the  earnings  forecasting 

process  and  (2)  to  provide  information  from  which  to  judge  the  adequacy 

of  the  forecasts  made  by  various  models.   The  ex  ante  nature  of  the 

causal  model  and  its  development  also  provide  the  necessary  bench  mark 

for  reviewers  to  evaluate  management  forecasts. 

Overview 
Scope  of  the  Research 

This  study  discusses  many  prediction  issues  and  conducts  empirical 
work,  to  test  the  value  of  a  causal  modeling  approach  to  earnings 
forecasting.   Drawing  from  theory  and  available  empirical  evidence,  a 
regression-based  model  is  developed  to  predict  earnings  before 
extraordinary  items.   An  ex  ante  distributed  lag  model  with  macro 
variables  is  chosen  because  of  its  ability  to  provide  a  true  forecast 
as  opposed  to  the  ex  post  "forecast"  of  correlational  regression 
models.   Predictions  of  this  model  and  a  number  of  alternative  models 
suggested  by  current  literature  are  obtained  for  a  sample  of  capital 
goods,  durable  goods,  and  drug  firms  on  both  an  annual  and  a  quarterly 
basis.   The  forecast  accuracy  of  the  models  is  compared  and  the  results 
of  this  comparison  are  used  to  help  establish  the  value  of 
macro-economic  variables  to  the  earnings  prediction  process. 

Any  conclusions  are  considered  preliminary  because  (1)  alternative 
structures  have  not  been  explored,  (2)  relatively  crude  methods  are 
used  to  predict  the  macro-economic  variables,  and  (3)  only  macro 
variables  are  used  instead  of  industry  or  firm-specific  variables.   Of 
course,  if  predictions  of  such  models  can  outperform,  or  perform  as 
well  as,  competitive  ones,  then  the  value  of  the  procedure  would  be 
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demonstrated  clearly;  thus,  an  independent  reviewer  (e.g.,  an  auditor) 
would  be  supplied  with  additional  evidence  with  which  to  judge  the 
adequacy  of  corporate  management's  financial  forecasts  of  earnings. 
Important  Definitions 

There  are  three  types  of  events  which  affect  a  firm's  financial 
performance.   These  are  (1)  firm  specific  occurrences,  (2)  industry 
events,  and  (3)  overall  macro-economic  conditions.   Yet  some  macro 
phenomena,  such  as  the  inflation  of  energy  costs,  impact  certain 
industries  much  more  than  others.   These  factors  are  considered  to  be 
macro  for  the  purpose  of  this  study. 

The  following  critical  distinction  between  ex  post  and  ex  ante 

forecasts  is  important  to  this  study: 

In  terms  of  time-series  models,  both  forecasts  predict  values 
of  a  dependent  variable  beyond  the  time  period  in  which  the 
model  is  estimated.  However,  in  an  ex  post  forecast  the 
forecast  period  is  such  that  observations  of  both  endogenous 
variables  and  the  exogenous  explanatory  variables  are  known 
with  certainty.   Thus,  any  ex  post  forecasts  can  be  checked 
against  existing  data,  and  provide  a  means  of  evaluating  a 
forecasting  model.  An  ex  ante  forecast  predicts  values  of 
the  dependent  variable  beyond  the  estimation  period,  using 
explanatory  variables  which  may  or  may  not  be  known  with 
certainty,  depending  on  the  nature  of  the  data  and  the  length 
of  the  lags  associated  with  explanatory  variables.  (Pindyck 
and  Rubinfeld,  1976,  p.  157) 

Macro-economic  forces  in  year  t-l   influence  the  performance  of 

corporate  earnings  in  year  t.   The  lingering  effect  or  prolonged  impact 

of  economic  downturns,  for  example,  means  that  past  (lagged)  macro 

activity  can  be  used  to  predict  future  earnings  realizations. 

Most  ex  ante  forecasting  requires  explanatory  (right  side) 

variables  to  be  predicted,  before  a  single  equation  regression  model 

can  be  used  to  forecast.   The  predicted  nature  of  these  independent 

variables  leads  to  a  forecast  of  the  dependent  variable  which  is  less 
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reliable  than  if  known  explanatory  variables  were  used,  but  not 
necessarily  less  reliable  than  models  omitting  important  explanatory 
variables. 

In  an  unconditional  forecast,  values  for  all  the  explanatory 
variables  in  the  forecasting  equation  are  known  with  certainty.   Any  ex 
post  forecast  is,  therefore,  an  unconditional  forecast.   In  order  to 
produce  an  unconditional  ex  ante  forecast,  the  explanatory  variables 
must  be  known  with  certainty  for  the  entire  forecast  period,  i.e., 
sufficient  lags.   In  a  conditional  forecast,  values  for  one  or  more 
explanatory  variables  are  not  known  with  certainty,  so  that  guesses 
(extrapolations  or  forecasts)  of  them  must  be  substituted.   For  a 
forecasting  equation  with  no  lags,  every  ex  ante  forecast  is  a 
conditional  forecast. 

Regressions  with  stochastic  explanatory  variables  are  common,  if 
not  predominant,  in  a  field  such  as  econometrics  where  the  problem  has 
been  studied  to  a  great  extent .   In  many  studies ,  the  values  of  the 
explanatory  variables  are  determined  (along  with  those  of  the  dependent 
variable)  as  a  result  of  some  probability  mechanism  rather  than  being 
controlled  by  the  experimenter. 

The  typical  accounting  time-series  literature  deals  with 
unconditional  forecasting.   A  "good"  model  in  terms  of  unconditional 
forecasting  may  perform  poorly  when  conditional  forecasting  is 
attempted.   One  should  not  be  too  quick  to  reject  a  model  with  a  high 
forecast  error  if  the  primary  component  of  that  error  is  due  to  the 
prediction  involved  in  the  determination  of  explanatory  values  during 
the  forecast  period.   The  ex  ante  approach  taken  here  does  not  rely  on 
any  information  which  is  not  actually  available  at  the  time  of 
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prediction.   The  implication  of  this  strategy  is  that  the  derived 
"forecasts"  are  truly  forward-looking  and  consequently  are  useful  to 
those  who  (1)  require  information  about  future  earnings  or  (2)  wish  to 
evaluate  various  other  forecasts  prior  to  the  actual  realization  date. 
As  a  bench  mark  for  the  evaluation  of  the  conditional  forecasts 
produced  in  this  study,  an  alternative  method  of  deriving  the 
explanatory  values  is  employed.   In  combination,  these  two  procedures 
allow  for  the  analysis  of  the  contribution  of  the  model  itself.   Two 
methods  of  macro-economic  variable  prediction  reveal  the  sensitivity  of 
the  model  to  the  quality  of  macro  forecast  and  isolate  the  component  of 
forecast  error  due  to  macro  prediction. 
Chapter  Organization 

Chapter  Two  discusses  the  current  state-of-the-art  of  earnings 
forecasts,  reviews  the  statistical  literature  and  summarizes  the 
importance  of  the  topic.   Building  on  this  foundation,  a  number  of 
specific  issues  are  established  and  discussed  in  Chapter  Three;  the 
synthesis  contained  therein  provides  a  basis  for  the  empirical  work 
which  follows.   The  justification  of  the  particular  approach  used 
requires  a  substantial  concatenation  and  constitutes  a  major  portion  of 
the  development  of  the  model.   After  the  rationale  for  the  general 
approach  to  the  model  is  established,  the  specific  forms  of  the  model 
are  developed  in  Chapter  Four.   The  results  are  presented  in  Chapter 
Five,  and  conclusions  and  extensions  are  given  in  Chapter  Six. 


CHAPTER  TWO 
LITERATURE  REVIEW 

This  chapter  discusses  the  prior  accounting  and  statistics 
literature  concerning  prediction  models.   Forecasting  methods  can  be 
grouped  into  two  sets  depending  on  whether  or  not  a  model  incorporates 
variables  other  than  past  observations  of  the  earnings  stream.   Methods 
which  use  only  the  past  time  series  of  earnings  are  pure  time  series 
models.   Methods  which  include  other  variables  can  also  be  of  a  time 
series  nature  and  are  fit  over  the  series  of  past  observations  of  some 
set  of  variables  which  may  possibly  include  earnings. 

The  chapter  also  provides  a  rationale  for  the  empirical  work 
presented  in  Chapters  Four  and  Five.   This  review  raises  several 
issues,  some  of  which  are  discussed  further  in  Chapter  Three.   Chapter 
Two  begins  with  background  material  and  motivation  for  the  current 
study. 

Background  and  Motivation 

Earnings  forecasting  is  of  interest  to  those  testing  valuation 
models,  the  relationship  between  unanticipated  earnings  and  stock 
prices,  or  the  information  content  of  earnings  disclosures.   There  are, 
however,  two  schools  of  thought  concerning  the  importance,  or  lack 
thereof,  of  earnings  prediction.   The  study  of  accounting  income  time 
series  per  se  without  first  establishing  the  theoretical  interest  in 
such  series  has  come  under  attack  by  Revsine  (1971)  and  Lauderback 
(1971).   On  the  other  hand,  Foster  (1978),  Gonedes  (1973),  and  Gray 
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(1973)  have  supported  the  importance  of  such  research  as  have  Beaver 

(1970)  and  May  and  Sundem  (1976)  and  others. 

The  main  criticism  of  the  numerous  predictability  studies 

conducted  to  date  is  that  the  various  models  and  methods  of  prediction 

have  been  applied  to  earnings  (an  artifact  of  historical  cost 

accounting)  instead  of  to  some  more  relevant  variable,  such  as  cash 

flow.   It  is  argued  that  what  is  really  needed  are  empirical  tests  of 

the  ability  of  the  various  methods  to  generate  reasonable  estimates  of 

cash  flows  and  that  the  results  of  predictability  studies  thus  far  are 

devoid  of  meaning  in  that  they  do  not  establish  a  correspondence 

between  income  forecasts  and  future  values  of  cash  flow.   This 

dissertation  does  not  address  this  issue  directly,  and  its  results  must 

be  viewed  with  this  caveat  in  mind.   Revsine  (1971)  argues  that 

.  .  .  only  one  justification  for  income  prediction  survives; 

that  is,  such  forecasts  are  useful  only  insofar  as  the  income 

concept  being  predicted  is  a  reasonable  indicator  of  some 

real  event (s)  [cash  flows,  for  example]  of  concern  to  users, 
(p.  488) 

Yet  a  great  deal  of  research  continues  relevant  to  the  time-series 

properties  of  earnings.   The  work  of  Watts  (1975),  Griffin  (1977), 

Foster  (1977),  Brown  and  Rozeff  (1979),  Lorek  (1978),  and  Hopwood 

(1980)  have  attracted  considerable  interest. 

Some  reasons  for  this  interest  are:  (1)  the  potential 
use  of  forecasts  of  accounting  numbers  as  inputs  to  decision 
models;  (2)  the  need  to  secure  proxies  for  unobservable 
expectations  in  order  to  test  economic  theories;  (3)  the  need 
to  use  such  statistical  models  within  the  context  of  studies 
dealing  with  the  predictive  ability  of  information  content  of 
accounting  numbers,  subjects  that  have  been  receiving 
increased  attention  during  the  past  few  years;  (4)  the 
growing  interest  in  examining  the  forecasting  success  of,  for 
example,  managers  and  financial  analysts  relative  to 
statistical  models  that  are  "appropriate"  for  the  accounting 
number  series  of  interest,  and  (5)  the  need  to  use  accounting 
numbers  in  testing  hypotheses  regarding  industrial 
organization  (e.g.,  market  concentration),  profitability,  and 
the  growth  and  decline  of  firms.   (Gonedes,  1973,  p.  212) 
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Statements  such  as  the  following  are  among  the  primary  motivators 

of  this  dissertation. 

Although  the  most  frequently  mentioned  forecast 
accounting  numbers  are  probably  net  income  and  earnings  per 
share,  they  are  probably  more  difficult  to  predict  and  also 
the  least  reliable.   This  results  from  the  fact  that  a 
projection  of  accounting  income  depends  on  many  subjective 
variables  and  many  assumptions  regarding  the  firm  and  the 
economy  ....  With  a  publication  of  the  forecast  of 
financial  accounting  information  and  other  information 
relating  to  the  firm,  it  is  necessary  that  the  basic 
assumptions  relating  to  the  economy  and  external  factors  be 
disclosed  so  that  the  users  of  the  forecasts  can  better 
evaluate  its  reliability.   Such  assumptions  should  include 
expectations  regarding  the  industry  as  well  as  assumptions 
regarding  changes  in  economic  conditions.  (Hendriksen,  1977, 
p.  5A9) 

Research  on  the  probabilistic  nature  of  earnings  ultimately  may 

help  users  of  financial  statements  to  evaluate  the  imprecise  nature  of 

reported  income  and  of  earnings  forecasts  disclosed  in  annual  reports 

to  stockholders  just  as  current  primary  and  fully  diluted  earnings  per 

share  (EPS)  indicate  a  range  of  possible  outcomes.   The  Executive 

Committee  of  the  Management  Advisory  Services  Division  of  the  American 

Institute  of  Certified  Public  Accountants  (AICPA)  created  a  task  force 

in  1973  to  develop  standards  for  a  CPA's  association  with  the  reporting 

of  financial  forecasts.   Somewhat  earlier  (and  continuing  on  through 

1979)  the  Securities  and  Exchange  Commission  (SEC)  issued  a  series  of 

releases  refining  its  position  with  regard  to  management  forecast 

disclosures.   The  final  link  in  the  entire  process  was  the  issuance  in 

October  1980  of  the  "Guide  for  a  Review  of  a  Financial  Forecast," 

prepared  by  the  Financial  Forecasts  and  Projections  Task  Force  of  the 

AICPA.   The  contents  include  definitions,  scope  of  the  reviev/, 

procedures  to  evaluate  assumptions,  and  sample  report  formats;  reprints 

of  an  SEC  Release  on  Disclosure  of  Projections  of  Future  Performance; 

and  other  AICPA  technical  pronouncements. 
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Independent  CPAs  are  now  allowed  (permitted,  but  not  required)  to 

review  and  to  report  on  estimates  of  the  most  probable  financial 

position  for  one  or  more  future  periods  although  "traditionally 

projections  have  been  given  for  three  items  ...  of  primary  interest 

to  investors:   sales  or  revenue,  net  income,  and  earnings  per  share" 

(p.  76).  Among  the  suggestions  mentioned  in  the  guide  are  two  of 

interest  to  this  study: 

The  accountant  should  obtain  knowledge  of  the  entity's 
business  and  the  key  factors  upon  which  its  future  financial 
results  depend,  focusing  on  such  areas  as  .  .  .  factors 
specific  to  the  industry,  including  competitive  conditions, 
sensitivity  to  economic  conditions  ....  (p.  6,7) 

The  accountant's  standard  report  on  a  review  of  a 
financial  forecast  should  include  ...  a  statement  regarding 
whether  the  underlying  assumptions  provide  a  reasonable  basis 
for  management's  forecast,  (p.  21) 

The  guide  also  encourages  but  does  not  require  subsequent  comparison  of 

actual  results  with  those  forecasted,  but  error  metric  issues  are  not 

addressed.   No  questions  of  percent  error  vs.  raw  error  or  of  absolute 

error  vs.  signed  error  are  raised. 

Evaluation  of  earnings  forecasts  is  possible  at  two  distinct 

points  in  time.   Before  observing  the  actual  outcome  of  some  future 

event  there  is  the  possibility  of  ex  ante  scrutiny  either  by  analysis 

of  the  basis  of  the  forecast  or  by  establishing  an  ex  ante  statistical 

confidence  Interval  around  the  point  estimate  by  formal  (discussed  in 

Chapter  Three)  or  informal  means  as  suggested  by  Daily: 

Investors  should  be  expected  to  anticipate  minor 
variations  between  a  forecast  and  actual  results  because  of 
the  nature  of  forecasting,  and  variations  within  the  range  of 
10  percent  to  15  percent  or  less  should  be  explainable  to  the 
satisfaction  of  most  investors.  (1971,  p.  688) 

After  the  actual  has  been  observed,  comparison  can  be  made  with  either 

the  range  mentioned  above  or  the  point  forecast  itself.   It  is  the 
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second  comparison  which  gives  rise  to  the  ex  post  error  measure  and  to 

the  volume  of  literature  to  date  concerning  the  predictability  of 

various  forecasting  models. 

The  accuracy  of  earnings  forecasts  has  received  a  major 
effort  in  the  literature.   The  need  for  more  accurate 
forecasts  provided  the  impetus  for  perfecting  some  mechanical 
forecasting  models.  At  first  comparisons  were  made  of  the 
relative  accuracy  of  various  mechanical  models.   Research 
technology  evolution  and  more  data  availability  allowed 
comparison  of  accuracy  of  forecasts  made  by  rigorous  time 
series  models  with  those  made  by  managements.   It  was  hoped 
that  these  comparisons  would  provide  some  inferences  as  to 
the  relative  value  of  privately  gathered  and  nonaccounting 
information.  Unfortunately,  the  evidence  to  date  is 
inconclusive.   In  some  industries,  mechanical  models  were 
found  to  be  as  good  forecasters  as  managements  or  better  than 
mechanical  models  on  the  average.   It  is  striking,  however, 
that  analysts  and  managements  did  not  continously  outperform 
mechanical  models.   We  feel  that  both  the  properties  of 
earnings  forecasts  and  the  question  of  their  value  continue 
to  be  a  fertile  area  for  research.   (Abdel-Khalik  and 
Thompson,  p.  202) 

Literature  on  the  Time-Series  Properties  of  Earnings 

Although  many  articles  refer  to  the  importance  of  macros  or  the 
influence  of  economic  conditions,  the  vast  majority  of  the  accounting 
literature  has  not  dealt  with  these  factors.   These  works  are  labeled 
here  as  time-series  research  studies.   Use  of  time-series  methodologies 
transforms  the  work  from  the  discovery  of  explanatory  exogenous 
variables  underlying  the  earnings  process  to  the  detection  of 
time-series  patterns  in  the  earnings  data  itself.   However,  "the  issue 
of  whether  there  are  systematic  patterns  in  the  annual  earnings  series 
of  individual  firms  that  can  be  exploited  for  forecasting  is  very  much 
an  unresolved  question"  (Foster,  1978,  p.  123).   It  is  the  predictive 
ability  criterion  which  provides  the  motivation  for  most  of  these 
studies. 
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The  time  series  of  earnings  literature  can  be  organized  according 
to  a  number  of  different  schemes  depending  on  the  emphasis  of  the 
studies  classified.   There  are  annual  as  well  as  quarterly  studies. 
There  are  studies  dealing  with  time-series  properties  and  with  the 
accuracy  of  various  time-series  models.   There  are  comparisons  among 
predictions  made  by  models,  managements,  and  analysts.   There  are 
studies  which  describe  alternative  earnings  series,  alternative 
prediction  horizons,  alternative  time  periods  being  forecast, 
alternative  industries,  alternative  error  measures,  and  alternative 
updating  techniques.   Finally,  some  studies  use  quarterly  forecasts  to 
predict  annual  forecasts — Green  and  Segall  (1966)  and  Lorek  (1979). 
Three  good  summaries  of  this  literature  are  Abdel-khalik  and  Thompson 
(1977-78),  Lorek  (1977-78),  and  Foster  (1978). 
Empirical  Works 

The  main  body  of  literature  is  concerned  with  the  relative 
accuracy  of  the  various  models  as  well  as  comparisons  of  predictions 
made  by  management  and  financial  analysts.   There  are  a  number  of 
different  model  types.   Naive  (ad  hoc)  models  include  extrapolations, 
random  walks,  simple  auto-regression,  mean  reverting,  and  some 
combinations  of  these.   Box- Jenkins  models  are  characterized  by  three 
steps:  identification,  estimation,  and  forecasting.   This  algorithm 
allows  for  the  flexibility  of  the  auto-regressive  integrated  moving 
average  (ARIl^)  family.   For  a  more  complete  explanation  of  the  BJ 
technique,  refer  to  Mabert  and  Radcllffe  (1974),  Nelson  (1973),  or  Box 
and  Jenkins  (1970). 

Annual  results.   Past  studies  concerning  the  time-series  behavior 
of  annual  earnings  include  Beaver  (1970),  Ball  and  Watts  (1972), 
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Lookabill  (1976),  Foster  (1977),  Watts  and  Lef twitch  (1977),  and 
Albrecht,  Lookabill,  and  McKeown  (1977).   The  results  of  these  research 
efforts  are  reasonably  consistent  and  allow  one  to  concentrate  on  the 
summarizing  nature  of  the  last  two  articles.  Watts  and  Lef twitch  state 
that  the  random  walk  (martingale)  model  is  still  a  good  description  of 
the  process  generating  annual  earnings  (p.  28).   More  specifically,  the 
random  walk  with  drift  (submartingale)  is  appropriate  for  nondeflated 
income  while  a  noisy  random  walk  works  for  earnings  per  share.   These 
conclusions  are  based  on  ex  post  error  measures  in  comparison  with 
other  time-series  models  only.   Thus,  the  random  walk  with  drift  model 
is  the  preferred  choice  among  the  time  series  subset  of  annual  earnings 
forecast  models.   The  Albrecht  et  al.  (1977)  formulation  of  this  model 
is  discussed  further  in  Chapter  Four  and  will  be  used  as  a  comparison 
in  the  annual  research. 

Quarterly  results.  Accounting  literature  has  distinguished  two 
types  of  applications  of  BJ  techniques.   One  method  (parsimonious 
models)  relies  on  prior  research  on  the  earnings  series  to  establish 
the  parameters  of  the  model,  thus  creating  a  so-called  nonspecifically 
identified  "premier"  model.   When  used,  this  procedure  omits  the 
regular  identification  stage  and  adopts  whatever  model  form  is  deemed 
appropriate  under  the  circumstances.   The  other  major  application  of 
the  BJ  technique,  individually  fitted/firm  specific  BJ  models,  is 
achieved  through  use  of  all  three  stages  in  the  iterative  process. 

Three  parsimonious  model  forms  have  been  offered  as  contenders  for 
the  premier  title.   They  have  come  to  be  known  by  the  names  of  the 
authors  who  have  championed  them: 
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(1)  Foster  (1977), 

(2)  Watts  (1975)  and  Griffin  (1977),  and 

(3)  Brown  and  Rozeff  (1979). 

Research  using  data  through  1975  prediction  quarters  indicates  the 
dominance  of  parsimonious  BJ  models  over  firm-specific  BJ  models  as 
well  as  naive  models.   This  literature  uses  data  sets  culminating  with 
1975  and,  therefore,  does  not  address  the  explosive  error  problem 
encountered  in  more  recent  studies.   However,  these  quarterly  results 
do  not  resolve  the  question  of  superiority  of  the  various  parsimonious 
models  themselves,  nor  could  they  speak  to  the  lack  of  superiority 
which  emerged  when  studies  began  to  predict  later  time  periods  [e.g., 
Hopwood,  Hillison,  and  Lorek  (1980),  Kee  (1980),  and  Abdul-kader 
(1979)].  These  newer  results  show  extremely  high  ex  post  error  measures 
for  all  BJ  model  predictions  and  leave  open  the  question  of  any 
long-term  validity  of  the  time-series  properties  of  earnings  using 
these  methods.  In  addition,  the  explosive  nature  of  the  errors  invokes 
statistical  questions  as  to  the  appropriateness  of  these  techniques. 
BJ  models  require  constant  variance  over  time,  which  clearly  is  not  the 
case  empirically.   Thus,  one  of  the  critical  assumptions  of  the 
methodology  is  violated.   These  and  similar  issues  are  discussed 
further  in  Chapters  Three  and  Four. 

Predictions  of  management  and  analysts.   Researchers  also  have 
studied  the  accuracy  of  financial  analysts'  and  managements'  (experts) 
predictions  of  earnings.   However,  few  conclusions  can  be  drawn.   Among 
the  studies  which  deal  with  this  area  are  Elton  and  Gruber  (1972), 
McDonald  (1973),  Daily  (1971),  Barefield  and  Comiskey  (1976),  Lorek, 
McDonald,  and  Patz  (1976),  and  Brown  and  Rozeff  (1978). 
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The  forecasts  made  by  management /analysts  can  be  compared  to  the 
predictions  of  time-series  models  or  to  any  other  model  type  which  does 
not  benefit  from  their  experience  or  inside  knowledge.   Two  viewpoints 
can  be  taken  with  regard  to  this  comparison.   First,  a  naive  model  can 
be  used  to  evaluate  the  reasonableness  of  an  expert's  ex  post  forecast 
error.   Conversely,  management  or  analyst  forecasts  can  be  used  as 
standards  by  which  to  evaluate  types  of  naive  forecasting,  including 
time-series  models.   If  used  in  this  second  way,  it  must  be  assumed 
that  an  expert  forecast  is  some  upper  bound  on  forecast  accuracy  due  to 
additional  information  available  to  them. 

Unfortunately,  past  research  has  shown  that  management  forecasts 
are  not  necessarily  better  than  those  of  the  models.   Abdel-khalik  and 
Thompson  (1977-78)  summarize: 

Researchers  disagree  as  to  whether  earnings  forecasts 
made  by  management  and/or  analysts  are  more  accurate  than 
forecasts  which  rely  on  mechanical  forecasting  models.  Most 
of  the  studies  conclude  that  analysts  and  mechanical  models 
perform  about  equally  well. 

The  evidence  to  date  does  not  show  that  information 
available  to  management  and  analysts  (beyond  that  required  by 
historically  based  time  series  models)  is  particularly 
valuable  for  making  more  accurate  forecasts. 

The  evidence  also  suggests  that  the  ability  to  forecast 
a  firm's  earnings  is  dependent,  to  some  degree,  on  the 
industry  in  which  it  operates. 

Security  analysts  seem  to  utilize  and  adapt  to  the  new 
information  contained  in  earnings  time  series,  (p.  192) 

As  a  result  of  these  findings,  one  can  conclude  that  the  value  of 

comparing  time-series  models  with  management  forecasts  is  in  the 

ability  of  the  models  to  help  evaluate  the  quality  of  management's 

disclosures.   Research  results  can  be  especially  helpful  in  providing 

evidence  of  the  relative  difficulty  of  the  forecasting  process  in 

different  industries  and,  to  some  extent,  in  providing  information  on 

bias  tendencies  of  over-  or  underprediction  in  certain  industries. 
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Synthesis  of  Time-Series  Research 

The  inconclusive  nature  of  the  predictability  research  evokes  a 
number  of  questions.   The  question  of  further  fruitful  time-series 
endeavors  is  indicated  perhaps  by  a  suggestion  made  by  Foster  in  his 
book,  (1978,  p.  107):   "An  interesting  extension  of  Foster  (1977)  would 
be  to  compare  model  5  vis-a-vis  model  6  when  the  parameters  of  both  are 
reestimated  each  quarter."  His  model  6  is  the  parsimonious  BJ  model 
referenced  earlier  under  his  name.   The  model  5  he  mentions  is  the  same 
general  model,  but  is  estimated  using  non-BJ  procedures.   Questions  of 
the  appropriateness  of  parsimonious  BJ  models  can  be  answered  only  by 
conducting  more  empirical  research.   Recent  studies  indicate  poor 
performance  of  BJ  techniques  and  raise  serious  methodological  questions 
for  the  continued  use  of  these  models  in  the  earnings  context. 

Foster  mentions  a  number  of  statistical  issues  with  regard  to  the 
use  of  BJ  models  in  accounting  earnings  studies.   Foster  (p.  106), 
Lorek  (1979,  p.  192)  and  Griffin  (1977,  p.  75)  allude  to  the 
overfitting  problem  of  firm-specific  BJ  models.  Another  problem 
concerns  the  fitting  period  for  these  models.   Unfortunately,  the 
length  of  time  required  to  estimate  BJ  models  increases  the  likelihood 
of  structural  change  since  there  is  an  opportunity  for  the  process 
generating  earnings  to  change  due  to  some  real  event.   Most  time-series 
applications  need  a  rather  large  number  of  observations,  say  fifty  or 
more.   "Unfortunately,  this  extension  of  the  time  period  increases  the 
likelihood  of  structural  change,  since  there  is  a  greater  opportunity 
for  the  time  series  of  earnings  to  change  from  one  stationary  process 
to  another  because  of  some  real  event,  such  as  a  merger"  (Watts  and 
Leftwich,  1977,  p.  255).   Depending  on  the  type  of  model  used,  the 


19 

question  of  such  nonstatlonarity  can  be  a  critical  Issue.   Some 
formulations  are  much  more  susceptible  to  structural  change  than  are 
others.   The  more  the  conditions  of  overfitting  exist  with  a  particular 
method,  the  more  likely  the  model  will  have  difficulty  beyond  the 
sample  period.   Forecasts  with  such  models  are  subject  to  extreme 
variability,  and  the  ex  post  error  measure  can  be  expected  to  fluctuate 
widely.   Thompson  and  Kemper  state  it  this  way:  "Variability  arises 
because  (1)  the  process  which  generates  the  data  is  stochastic  and/or 
(2)  the  estimating  process  is  imperfect"  (1965,  p.  575). 

Nonstatlonarity  can  be  classified  into  two  types:  gradual  and 
jump.   Primary  examples  of  the  first  type  are  changing  consumer  tastes 
and  subtle  changes  in  the  economy.   Examples  of  the  second  type  are 
generally  firm  specific — such  as  new  products,  a  change  in  leadership, 
sudden  inflation,  and  new  cost  interrelationships  such  as  much  higher 
energy  costs  relative  to  other  costs.   The  use  of  a  confidence  interval 
for  a  forecast  is  especially  important  when  there  is  a  question  of 
nonstatlonarity.   This  fact  is  pointed  out  by  Birnberg  and  Slevin 
(1976,  p.  157):   "[the]  condition  where  the  interval  statement  may  be 
useful  is  when  the  underlying  process  changes." 

No  prediction  model  can  incorporate  all  factors  for  practical 
reasons  and  because  reduced  forecastability  can  be  expected  to  result. 
On  the  other  hand,  lack  of  consideration  of  essential  elements 
affecting  future  earnings  also  can  have  a  detrimental  impact  on 
forecast  performance.   This  is  especially  important  if  one  agrees  that 
the  earnings  generation  process  is  not  a  function  of  the  time-series 
properties  of  reported  earnings  but  results  from  production,  marketing, 
and  finance  decisions  as  well  as  from  changes  in  the  economy. 
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Lorek  (1977-78)  frequently  reminds  us  of  the  caveat  that  most 

accounting  time-series  models  are  devoid  of  economic  variables. 

However,  of  time-series  research,  he  states:   "In  essence,  we  examine 

an  Impact  of  several  economic  variables  on  the  series  by  allowing  the 

series  Itself  to  provide  clues  regarding  the  expectation  model"  (1979, 

p.  191).   The  synthesis  points  to  the  need  to  (1)  eliminate  statistical 

weaknesses  generally;  (2)  directly  compare  alternative  models,  both 

time-series  models  (e.g.,  Foster's  model  5,  model  6)  and  other  model 

forms;  and  (3)  study  models  which  Incorporate  exogenous  economic 

factors.   The  application  of  models  such  as  those  of  Foster, 

Grlf fin-Watts,  and  Brown  and  Rozeff  to  data  of  recent  years  has  left 

the  value  of  their  methods  open  to  considerable  question  due  primarily 

to  the  large  prediction  errors  which  have  resulted.   This  raises  the 

Issue  of  other  variables  being  used  in  the  prediction. 

Use  of  Economic  Variables  and  Index  Models 

Prior  Support  for  Use  of  Macros 

In  general,  the  importance  of  these  factors  is  not  disputed: 

Those  who  use  financial  Information  for  business  and 
economic  decisions  need  to  combine  information  provided  by 
financial  reporting  with  pertinent  Information  from  other 
sources,  for  example.  Information  about  general  economic 
conditions  or  expectations,  political  events  and  political 
climate,  or  Industry  outlook.  (SFAC  #1,  1978,  p.  10) 

Empirical  support  for  the  use  of  macro-economic  factors  is  also 

available.   Among  the  many  (primarily  accounting)  studies  which  have 

utilized  economic  variables  are  the  following:  Albrecht  and  McKeown 

(1976),  Brown  and  Ball  (1967),  Elliott  and  Uphoff  (1972),  Foster 

(1978),  Gonedes  (1973),  Gould  and  Nelson  (1974),  Hopwood  (1980),  King 

(1966),  Lev  (1980),  Magee  (1974),  Prakash  and  Rappaport  (1974),  and 

Saunders  (1978).   The  pages  which  follow  dwell  heavily  on  this 
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literature  for  both  the  theory  given  and  the  empirical  results 

obtained. 

One  of  the  first  studies  to  examine  the  importance  of  economy  and 
industry  factors  on  earnings  was  Brovm  and  Ball  (1967).   They 
determined  that  ".  .  .  on  average,  approximately  35-40%  of  the 
variability  of  a  firm's  annual  earnings  numbers  can  be  associated  with 
the  variability  of  earnings  numbers  averaged  over  all  firms;  ...  on 
average,  a  further  10-15%  can  be  associated  with  the  industry  average" 
(p.  65).  Another  study  which  dealt  with  the  impact  of  market-wide 
factors  demonstrated  that  these  factors  were  statistically  important 
determinants  of  firms'  operating  results  [Gonedes  (1973),  p.  235]. 

These  economy-wide  studies  attempt  to  describe  cross-sectional 
dependencies  with  respect  to  firms'  accounting  numbers.   Some  specific 
potential  sources  of  cross-sectional  dependencies  are  changes  in  the 
economy's  production  technology,  the  effects  of  economic  stabilization 
policies,  and  the  resource  flows  and  relative  price  changes  associated 
with  general  equilibrium  forces.   "All  firms  in  the  economy  are 
affected  to  some  degree  by  monetary  policy  or  changes  in  interest 
rates.   The  factors  shared  by  firms  in  a  given  industry  would  include 
the  demand  for  the  products  of  the  industry  and  the  movements  of  other 
firms  into  and  out  of  the  industry"  (Brown  and  Ball,  1967,  p.  56). 

Hopwood.   In  a  procedure  which  incorporates  industry-wide  and 
economy-wide  factors,  Hopwood  (1978)  distinguishes  models  by  the  data 
sets  utilized  and  defines  three  distinct  data  sets  (p.  13): 

(1)  data  internal  to  the  firm  (earnings  excluded,  i.e.,  ratios); 

(2)  data  external  to  the  firm;  and 

(3)  earnings  data. 

He  then  derives  a  set  of  uncorrelated  indices  computed  from  ratio, 
market,  and  industry  data  in  an  attempt  to  improve  earnings  per  share 
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predictability.   His  procedure  is  a  firm-identified,  multivariable, 

longitudinal  model  utilizing  simultaneously  internal,  external,  and 

earnings  data  sets.   In  a  refinement  of  this  research,  Hopwood  (1980) 

investigates  the  relative  forecast  accuracy  of  a  basic  ARIMA  model  and 

an  index  model  using  EPS  data  taken  from  Moody's  Handbook.   This  second 

model  is  a  single-input  transfer  function  (TF)  with  an  market  or 

industry  price  index  used  as  the  input  variable.   The  indices  were 

Standard  and  Poor's  (S+P)  Composite  Index  and  S&P's  Air  Transportations 

Industry  Index. 

Using  both  indices,  "the  TF  forecasts  are  not  significantly 

different  than  the  ARIMA  forecasts"  (p.  82).   However,  Hopwood  found 

that  "if  a  transfer  function  outperformed  an  ARIMA  model  for  the  first 

three  periods  in  the  forecast  horizon,  then  there  was  a  high 

probability  that  it  would  do  the  same  for  periods  four  through  ten"  (p. 

88).   Hopwood 's  work  suggests: 

that  for  about  one-half  of  the  firms  studied,  at  least  one  of 
the  TF  models  provided  a  better  descriptive  forecast  model  of 
the  underlying  earnings  process.   Evidence  of  the  superiority 
of  these  TF  models  was  that  those  which  dominated  the  ARIMA 
models  for  the  first  three  periods  could  be  expected,  with 
significant  probability,  to  continue  to  do  so  over  the  next 
seven  periods. 

One  implication  of  this  result  is  that  about  one-half  of 
the  ARIMA  models  were  suboptimal.   We  should  not  jump 
immediately,  however,  to  the  conclusion  that  the  result  is  an 
artifact  of  the  transfer-function  modeling  process  and  not 
the  predictive  value  of  the  input  series.   This  possibility 
was  investigated  before  economic  explanations  were 
considered,  (p.  85) 

I  conclude  there  is  insufficient  evidence  to  attribute 
the  improved  forecasts  of  the  TF  models  to  the  predictive 
value  of  the  input  series,  (p.  86) 

The  evidence  here  is  not  sufficient  to  determine  whether 
industry  and  price  indices  have  predictive  value  in 
themselves.   First,  the  present  study  is  subject  to  the  use 
of  the  TF  methodology  and  it  is  possible  that  an  alternative 
methodology  might  be  more  sensitive.   Future  research  is 
needed  on  comparisons  of  alternative  methodologies  for 
measuring  the  predictive  value  of  multivariate  time  series, 
(p.  86) 
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Hopwood  also  had  the  explosive  error  problem  with  10  percent  of  the 

absolute  percent  error  measures  more  than  three  standard  deviations 

from  the  mean  and  "a  large  number"  in  excess  to  twenty-five  standard 

deviations  (p.  81). 

Lev.   In  another  1980  study,  Lev  examined  the  predictability  of 

models  such  as 

where  M  is  gross  national  product  (GNP)  or  total  corporate  profits 

(TCP)  after  taxes  in  current  dollars.   He  found  these  index  models  to 

be  more  acccurate  predictors  of  annual  sales,  operating  income,  and  net 

income  than  a  random  walk  with  drift  at  a  one-year  forecast  horizon. 

Although  Lev  states  that  "conditional  one-year-ahead  predictions  of  the 

firms'  variables  were  generated  from  the  estimated  index  models  and 

from  forecasts  of  the  indexes,"  he  also  states: 

For  each  of  the  seven  years  1968-1974,  predictions  of  sales, 
operating  income,  and  net  income  for  each  sampled  firm  were 
made  from  the  estimated  index  model  parameters  and  the  GNP 
and  TCP  forecasts  (independent  variables)  published  in  August 
of  each  predicted  year.  (p.  532) 

This  finding  and  the  preceding  one  are  consistent  with  the 
hypothesis  underlying  this  study  (and  with  available 
evidence),  that  firms'  financial  variables  are 
contemporaneously  closely  associated  with  economy-wide 
indexes,  (p.  531) 

Thus,  his  forecasts  are  neither  causal  nor  a  full  one-year  forecast 

horizon,  althougth  they  do  come  at  yearly  intervals.   The  model  was 

reestimated  each  year.   Industries  studied  included  packaged  food, 

paper,  chemicals,  air  transport,  retail-department  stores,  retail-food 

chains  and  oil  integrated-domestic. 

A  two  factor  model  also  included  industry  sales  or  industry  net 

income  predictor  variables.   Because  predictions  of  industry  indexes 


24 
for  the  years  1968-74  were  not  available.  Lev  restricted  the  prediction 

tests  of  the  two-factor  models  to  one  year  only,  1968. 

It  can  be  reasonably  concluded,  therefore,  that  incorporation 
of  an  industry  factor  improved  the  predictive  ability  of  the 
index  models,  particularly  for  the  operating  and  net  income 
series. 

To  summarize,  the  predictive  ability  tests  of  the 
single-factor  differenced  index  models  for  the  three 
accounting  series  examined  were  found  to  be,  in  general, 
superior  to  both  the  levels  index  models  and  the 
submartingale  benchmark  models,  (p.  535) 

Lev  also  points  out  that  index  models  generate  more  skewed  (than 

bench  mark)  error  distributions,  thus  resulting  in  a  high  number  of 

large  errors  (p.  535).   Evidently  to  avoid  this  explosive  error 

problem.  Lev  based  his  findings  on  median  prediction  errors.   His  major 

conclusion  is  expressed  thusly: 

It  appears  that  the  relationship  between  firm  variables  and 
economy-wide  indexes  is  stronger  for  nondurable  and  service 
industries  than  for  durable  good  industries.   This  is 
probably  explained  by  the  fact  that  demand  for  nondurables 
and  services  is  more  stable  over  time  than  demand  for  durable 
goods,  (p.  531) 

Based  on  mean  square  error  MSE,  for  instance,  his  results  might  have 

been  much  different. 

Not  all  researchers  support  the  use  of  macro  factors,  especially  if 

the  mechanism  used  is  regression  based.   Mandelbrot  (1963,  p.  409) 

discusses  specifically  the  failure  of  least-squares  method  in 

forecasting,  and  Albrecht  and  McKeown  (1976) 

have  provided  evidence  to  show  that  (1)  regression  analysis 
was  inappropriate  to  analyze  economic  data  where  the  time 
series  observations  were  not  independent  .  .  .  (2)  the 
bivariate  Box- Jenkins  time  series  analysis  is  a  methodology 
capable  of  articulating  the  nature  of  the  relationship 
between  two  variables  when  the  data  are  available  in  a  time 
series,  (p.  13) 

Econometric  models.   A  category  of  methods  which  is  broader  than 
regression  models  is  the  set  of  econometric  models.   "One  motivation  in 
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using  an  econometric  model  for  forecasting  a  firm's  earnings,  sales, 

etc. ,  is  to  exploit  more  information  than  is  available  in  the  past 

sequence  of  the  variable  being  forecast"  (Foster,  1978,  p.  111). 

Econometric  models  rely  on  established  statistical  procedures  and 

economics.   One  or  more  equations  is  used,  based  on  the  existing  or 

assumed  relationship  or  structure  among  the  variables.   Often  the 

parameters  are  estimated  using  a  regression  technique  such  as  ordinary 

least  squares.  A  linear  regression  using  economic  forces,  such  as  GNP, 

etc.  as  exogenous  independent  variables,  would  be  an  econometric  model 

with  a  very  informal  structure — index  model  form. 

The  reason  for  considering  linear  models  is  the  same  as  that  for 
many  other  existing  model  forms.   These  techniques  have  the  ability  to 
capture  relationships  between  variables  and  can  be  applied  easily. 
General  linear  models  are  important  to  the  accounting  applications 
considered  in  this  project  because  of  the  presence  of  numerous 
variables  and  because  of  the  need  to  deal  with  the  resulting 
complexity.   A  complication  arises  when  lagged  values  of  the  dependent 
variable  are  on  the  right  side  of  the  prediction  equation.   This  test 
does  not  have  the  common  interpretation  nor  is  it  valid  under  these 
circumstances  (Elliott  and  Uphoff  1972,  and  Johnston  1963). 

Any  use  of  regression-based  probabilistic  models  hopefully  would 

be  based  on  adequate  prior  theory.   Thomas  (1974)  gives  the  following 

example  of  the  danger  of  employing  correlational  regressions  for  the 

purposes  of  prediction  while  disregarding  causal  explanations: 

.  .  .  one  who  has  concluded  that  soda  is  intoxicating  because 
he  or  she  has  become  drunk  on  bourbon  and  soda,  rye  and  soda, 
and  rum  and  soda  may  be  disappointed  by  ice  cream  sodas,  (p.  77) 
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An  assumption  in  building  single-index  or  multi-index  models  is 

that  economy-wide  or  industry-wide  factors  are  useful  in  predicting  an 

individual  firm's  accounting  numbers.  An  important  consideration  is 

the  ease  with  which  the  properties  of  the  economy  or  of  the  industry 

variables  themselves  are  identified.   "Most  work,  on  building  such 

structural  econometric  models  has  been  done  at  the  economy  or  industry 

level  ....  In  comparison,  work  on  causal  modeling  of  the  financial 

series  of  individual  firms  is  relatively  less  developed"  (Foster,  1978, 

p.  82). 

The  use  of  simultaneous  equation  econometric  models  in  an 

accounting  context  is  rare.   Elliott  and  Uphoff  (1972)  is  the  only 

example  in  the  accounting  literature,  although  they  indicate  three 

other  studies  which  dealt  with  "predicting  elements  of  financial 

performance"  (p.  260).   They  apply  econometric  techniques  to  forecast 

elements  of  the  income  statement  using  industry  and  market  data  and 

give  examples  of  uncorrelated  indices  (p.  261). 

Causal  Modeling  Approach 

The  application  of  models  such  as  those  of  Foster,  Griffin-Watts 

and  Brown  and  Rozeff  to  data  of  recent  years  has  left  the  value  of 

their  methods  open  to  considerable  question  due  primarily  to  the  large 

prediction  errors  which  have  resulted.   This  raises  the  issue  of  other 

variables  being  used  in  prediction  and  brings  to  mind  an  observation  by 

Revsine 

To  be  a  useful  predictor,  an  income  concept  need  not  be 
relatively  stable  from  period  to  period.   If  the  variable  for 
which  a  prediction  is  desired  is  volatile,  then  the  best 
possible  prediction  would  be  similarly  volatile  with  a 
reasonable  lead.  (1971,  p.  488-9) 
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Prior  accounting  studies  have  relied  on  correlational  relation- 
ships as  well  as  cross-sectional  methodologies.   Consequently,  their 
success  in  forecasting  has  been  very  limited  since  prediction  requires 
intertemporal  validation  (ex  ante),  whereas  explanation  requires  only 
cross-validation  (ex  post).   The  correlational  nature  of  a  formulation 
such  as  Lev  (1980)  does  not  give  rise  to  the  causal  or  temporal  impact 
of  any  macro-economic  factor  which  might  influence  future  earnings. 

Given  the  aim  of  this  paper  to  incorporate  macro-economic 
variables  into  the  prediction  model,  it  becomes  necessary  to  find  a 
model  form  which  does  not  suffer  from  the  shortcomings  of  a  statistical 
nature  as  discussed  earlier.  A  form  of  time  series  regression  is  the 
most  obvious  choice,  but  there  are  some  problems.   When  a 
regression-based  model  is  estimated  using  data  over  time,  there  exists 
the  possibility  of  autocorrelation  of  the  residuals.   Two  other 
difficulties  are  underestimation  of  the  sample  variances  and 
inefficient  predictions.   Regression  studies  have  been  criticized  for 
lack  of  consideration  of  this  problem,  e.g.,  Godfrey  (1973),  Godfrey 
(1974),  Granger  (1974),  Howrey  et  al.  (1974),  and  Jensen  (1979). 
Variations  to  the  standard  regression,  which  solve  this  problem,  have 
been  developed;  in  particular,  the  suggestions  of  Feldstein  (1971), 
Fuller  (1976),  Pindyck  and  Rubinfeld  (1976),  Granger  and  Newbold 
(1977),  and  Johnston  (1963)  apply.   The  alternatives  to  basic 
regression  include  distributed  lag,  dynamic  regression,  and  spectral 
analysis.   Spectral  analysis,  like  the  Box- Jenkins  methodology,  is  an 
example  of  the  statistical  modeling  approach. 

The  distributed  lag  methodology,  when  it  includes  lagged  values  of 
both  the  dependent  and  the  independent  variables,  is  an  example  of  the 
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causal  modeling  approach  to  econometric  modeling.   In  this  approach, 

predictions  are  obtained  using  historical  values  of  endogenous  and 

exogenous  variables  and  projected  values  of  exogenous  variables.   The 

technique  is  explained  by  Wallis  (1967),  Johnston  (1963,  p.  315-320), 

and  Fuller  (1976,  p.  429-446). 

The  usefulness  of  macro-economic  variables  for  forecasting 

purposes  remains  an  empirical  question  to  be  addressed  in  this 

dissertation. 

Unfortunately,  econometric  models  have  as  yet  failed  to 
demonstrate  higher  predictive  power  than  the  previously 
mentioned  extrapolative  models.  Much  more  research  is 
necessary  on  structural  specification  and  parameter 
estimation  before  the  potential  of  this  forecasting  tool  is 
more  fully  realized.  (Lorek,  1977-78,  p.  215) 

Having  reviewed  the  relevant  literature  involving  both  time-series 

earnings  prediction  and  the  use  of  econometric  formulations,  there 

remain  major  epistomological  issues  which  impinge  on  one's  ability  to 

improve  earnings  forecasting.   Some  of  these  issues  relate  to  the 

nature  of  the  information;  others  relate  to  the  incorporation  of  these 

data  metholologically/statistically.   The  following  chapter  provides  an 

in-depth  discussion  of  a  number  of  these  issues. 

Note  to  Chapter  Two 
1.   Both  a  martingale  and  a  pure  random  walk  are  modeled  as 

^t  =  ^-1  ■"  \' 

Thus  the  expected  earnings  (E)  number  in  year  t  is  the  earnings  in 
year  t-1.   The  only  difference  between  the  two  models  is  that  the 
martingale  model  has  no  distributional  assumptions  on  the  error 
term,  e  . 


CHAPTER  THREE 
EPISTOMOLOGICAL  ISSUES 


This  chapter  deals  with  a  number  of  epistomological  issues  and 

raises  certain  questions  with  regard  to  numerous  relationships  and 

interactions.   These  interactions  include  those  between  management  and 

the  reviewer  of  earnings  forecasts  made  by  management,  between  earnings 

models  and  prediction  accuracy,  between  the  various  elements  of  the 

economy,  and  between  the  disclosure  of  financial  information  and  future 

events. 

Given  the  often-stated  importance  of  earnings  prediction  in 
the  investment  and  financial  analysis  literature,  it  is 
surprising  how  little  analysis  of  (and  evidence  pertaining 
to)  prediction  issues  is  contained  in  this  literature. 
(Foster,  1978,  p.  80) 

Evaluation  of  Management  Forecasts 
This  section  deals  with  a  number  of  issues  related  to  the 
production  and  evaluation  of  forecasts  made  by  management  and  by 
various  models  used  to  predict  earnings.   The  emphasis  is  on  the  impact 
of  interaction  effects  which  result  because  of  the  nature  and  type  of 
information  used  to  formulate  and  communicate  the  forecast  and  its 
accuracy.   Resolving  these  issues  requires  subjective  judgments  on  the 
part  of  the  researcher  as  well  as  independent  reviewers.   The  American 
Institure  of  Certified  Public  Accountants  (AICPA)  already  has  taken 
note  of  the  subjective  nature  of  the  assumptions  which  management  must 

make  in  creating  a  financial  forecast. 

29 
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Management  Forecasting  Systems 

No  matter  what  the  nature  of  a  management  forecasting  system, 
management  and  the  independent  reviewer  must  exercise  judgment  with 
regard  to  some  uncertain  event  or  events.   In  arriving  at  these 
judgments,  it  is  desirable  to  be  as  formalized  as  possible.   However, 
if  some  decisions  have  little  or  no  hard  evidence  on  which  to  proceed, 
making  the  evaluation  of  this  information  as  objectively  as  possible  is 
important.   It  also  is  important  to  keep  in  mind  the  assumptions  made 
during  the  construction  of  a  forecasting  system.   The  assumptions  which 
underlie  financial  forecasts  are  "extensive  in  number  and 
nonproportional  in  their  impacts  on  net  income  ..."  (Williams,  1977, 
p.  29).   This  point  also  is  made  by  Elgers,  Clark  and  Speagle  (1974). 
Williams  points  out  that  one  must  be  "particularly  careful  of 
important,  but  often  subtle,  relationships  between  the  assumptions 
embedded  in  the  base  case  when  changes  are  introduced  into  the  model" 
(p.  24). 

Evaluating  the  impact  of  forecasting  systems,  which  is  a  necessary 
task  of  both  management  and  the  reviewer,  depends  on  the  complexity  and 
design  of  the  system  itself.   The  most  formal  systems  may  be 
computerized  models.   Decision  makers  constantly  face  uncertain 
situations  which  require  action  based  on  estimates  of  relevant 
variables,  which  are  not  known  at  the  time  of  the  decision  and 
consequently  must  be  predicted.   If  a  management  forecasting  system  is 
sufficiently  complex,  then  it  might  rely  on  some  techniques  which  have 
been  successful  in  econometrics  and  statistical  decision  theory.   Other 
systems  could  be  more  of  the  seat-of-the-pants  variety  and  may  be  based 
on  no  more  formalized  a  system  than  a  series  of  reasonable  judgments 
derived  logically  from  management's  past  experience.   The  use  of  either 
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extreme  involves  inherent  difficulty  in  evaluating  the  impact  of 

external  events  as  well  as  internal  events. 

Because  of  the  complexity  of  most  economic  inter- 
relationships, there  is  probably  no  quantitatively  based 
technique  that  could  monitor  this  potential  shortcoming. 
Management  and/or  staff  analysts  estimated  these 
relationships  when  the  model  was  initially  constructed,  and 
they  should  remain  sensitive  to  all  potentially  major 
ramifications  of  them  on  their  "what  if"  questions. 
(Williams,  1977,  p.  24) 

Review  of  Financial  Forecasts 

Independent  review  of  management's  earnings  forecasts  by  a  CPA  is 
a  relatively  new  phenomenon,  especially  with  respect  to  compliance  with 
the  recently  issued  AICPA  guide  on  the  subject.   In  all  likelihood, 
part  of  the  assessment  the  reviewer  makes  concerning  the  forecast  and 
its  underlying  assumptions  will  be  the  formulation,  in  the  reviewer's 
mind,  of  some  notion  as  to  the  likelihood  that  the  company  can  reach 
the  estimated  earnings  number.   This  evaluation  undoubtedly  will  be 
judgmental  in  nature,  arrived  at  through  a  probabilistic  thought 
process. 

In  order  to  make  this  probabilistic  notion  operational,  there  must 

be  an  interval  placed  around  a  point  forecast.   The  reviewer  can  form 

one  in  his  mind  or  can  require  management  to  produce  one  for  his  use  in 

evaluating  the  assumptions  of  the  model.   Whether  this  information  is 

reported  to  the  public  is  also  an  issue  here  because 

.  .  .  investors  cannot  assume  that  all  reported  quantitative 
data  have  the  same  probability  of  accuracy.  Therefore, 
research  in  accounting  should  focus  on  the  method  of 
measuring  and  reporting  probabilistic  data  rather  than 
deterministic  amounts.   (Hendriksen,  1977,  p.  547) 

From  a  theoretical  standpoint,  quantifying  the  uncertainty  around 

economic  variables  is  a  more  accurate  way  of  reflecting  economic 

reality  and  more  closely  portrays  the  results  of  the  measurement 
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process.  From  a  normative  viewpoint,  the  disclosure  of  uncertainties 

should  increase  the  value  of  financial  statements  by  indicating  the 

inherent  differences  in  reliability  attached  to  various  pieces  of 

information.   In  either  case,  financial  data  (including  forecasts) 

should  not  be  presented  in  such  a  way  as  to  imply  a  misleading  degree 

of  precision  or  reliability.   Comparability  is  weakened  if 

uncertainties  which  vary  significantly  among  companies  and  industries 

are  obscured  or  ignored. 

To  satisfy  individual  preferences  for  predicting  and  controlling 
the  Impact  of  uncertain  events  on  enterprise  earning  power,  some 
apparently  simple  quantifications,  such  as  net  income,  need  to  be 
supplemented  to  represent  their  actual  complexities  by  disclosing 
ranges  of  precision,  reliability,  or  probability  distributions  over 
relevant  variables.  At  present,  both  primary  earnings  per  share  (EPS) 
and  fully  diluted  EPS  are  required  in  financial  statements  in  order  to 
provide  the  reader  with  more  than  the  simple  net  income,  thus  giving  a 
range  from  an  expected  to  a  worst-possible  situation. 

Accountants  need  a  statistical  methodology  in  order  to  express  the 

stochastic  nature  of  financial  accounting  numbers,  especially  earnings 

forecasts;  and  users  need  variability  data  in  order  to  determine  the 

risk,  involved  in  their  decisions.   In  most  situations,  no  single  bit  of 

information — stockholders'  equity,  net  Income,  cash  flows,  or  capital 

position — can  provide  all  the  necessary  input  for  a  decision. 

Ultimately,  the  question  Involves  projections  of  future  events  and  the 

related  uncertainty  of  them. 

The  information  provided  by  financial  reporting  often  results 
from  approximate,  rather  than  exact,  measures.   The  measures 
commonly  Involve  numerous  estimates,  classifications, 
suimnarlzations,  judgments,  and  allocations.   The  outcome  of 
economic  activity  in  a  dynamic  economy  is  uncertain  and 
results  from  a  combination  of  many  factors.   Thus,  despite 
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the  aura  of  precision  that  may  seem  to  surround  financial 
reporting  in  general  and  financial  statements  in  particular, 
with  few  exceptions  the  measures  are  approximations,  which 
may  be  based  on  rules  and  conventions,  rather  that  exact 
amounts.   (Statement  of  Financial  Accounting  Concepts  No.  1, 
1978,  p.  9) 

Even  if  interval  data  are  not  publicly  disseminated,  the  independent 

reviewer  should  request  management  to  provide  an  estimation  of  the 

sensitivity  of  the  forecast  to  the  assumptions. 

It  would  seem  that  a  complete  estimate  of  future  uncertain 

earnings  would  include  both  a  point  estimate  and  a  confidence  interval 

around  it.   This  point  is  made  by  a  AAA  committee  which  stated: 

The  treatment  of  uncertainty  in  accounting  should  perhaps  be 
divided  into  two  facets.   First,  there  is  the  analytical 
process  of  observing  certain  selected  characteristics  of  a 
factual  situation  for  the  purpose  of  assessing  the  degree  of 
uncertainty  which  is  inherent  in  the  situation.   Second, 
there  is  the  process  of  designing  financial  reports  so  that 
the  accountant's  assessment  of  uncertainty  is  conveyed  in  the 
financial  statements.  (Committee  on  Concepts  and  Standards 
External  Financial  Reporting,  1974,  p.  204) 

Interaction  of  Reported  Information  and  Future  Events 
If  any  reported  financial  data  have  relevance  or  usefulness  to 
users,  it  must  be  assumed  that  there  is  an  interaction  between  that 
disclosure,  stock,  prices,  and  consumer  behavior.   Consider  the  current 
situation  of  Chrysler  Motors.   Due  to  their  tenuous  financial  position 
there  is  a  lack  of  consumer  confidence  in  their  products.   People  may 
not  be  willing  to  buy  a  car  from  a  company  which  may  not  be  around  to 
provide  future  service.  Assume  it  develops  that  Chrysler's  point 
forecast  of  future  earnings  is  reasonably  good  and  that  the  "proper" 
interval  is  relatively  large  due  to  Chrysler's  uncertain  future.  Would 
the  disclosure  of  this  good  forecast  alter  the  value  of  the  interval  or 
otherwise  change  consumer  confidence  from  what  it  would  have  been  had 
the  information  not  been  disclosed?   If  confidence  can  be  altered,  then 
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the  situation  is  similar  to  the  problem  in  which  the  act  of  measurement 

alters  the  system  being  measured. 

Issue  of  Accountant  Interference 

Since  what  accountants  report  can  have  an  impact  on  future  events 
involving  a  business  entity,  it  is  natural  to  question  whether  the  link 
creates  fluctuations  in  earnings.   Prior  research  indicates  that 
accounting  does  not  necessarily  accentuate  business  fluctuations  (Ray, 
1960).  However,  even  if  accountants  do  not  contribute  to  changes  in 
the  level  of  relevant  variables,  the  measurement  process  may 
contribute,  to  some  extent,  to  the  uncertainty  if  there  is  interaction 
over  time. 

In  terms  of  economic  reality  and  the  measurement  problem,  all  the 
various  elements  of  the  process  are  related.   When  management  prepares 
financial  statements  or  forecasts,  certain  judgments  and  measurements 
relating  to  the  economics  of  the  firm  are  made.   No  matter  what  the 
purposes  of  such  reports,  the  information  collected  can  have  an  impact 
on  the  future  operations  of  the  enterprise  because  of  the  interaction 
between  the  accountant's  measures  and  the  system  in  which  he  is  taking 
the  measurement.   The  object  of  accounting  research  may  be  to  clarify 
the  relationship  between  economic  events  affecting  an  entity  and  the 
information  recorded  about  that  entity.   The  relationship  is  mutual,  in 
the  sense  that  research  may  be  directed  toward  the  process  in  which 
information  is  generated  from  economic  events,  or  it  may  be  directed 
toward  the  reverse  process  in  which  economic  events  are  affected  by 
information. 

Accounting  can  learn  a  great  deal  from  work  done  previously  in 
other  fields  of  endeavor  which  have  faced  similar  problems. 
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A  committee  of  the  American  Accounting  Association  (AAA)  touched  on 

this  fact  in  1966: 

Another  aspect  of  multiple  valuations  involves  the  use  of 
nonde termini Stic  measures  or  quantum  ranges  with  or  without 
probabilistic  measures.   In  view  of  uncertainties  surrounding 
business  activities  and  the  measurement  of  their  impact,  the 
use  of  such  non-deterministic  measures  is  likely  to  become  a 
part  of  an  expanded  accounting  discipline  of  the  future. 
(Committee  to  Prepare  a  Statement  of  Basic  Accounting  Theory, 
p.  65) 

Other  disciplines  long  have  studied  the  problems  of  uncertainty,  and 

the  use  of  the  word  "quantum"  here  suggests  a  look  at  the  statistical 

problems  of  physics. 

One  of  the  foundations  of  modern  physics  is  the  quantum  theory. 
When  first  introduced  in  the  scientific  community,  it  marked  a 
significant  breakthrough  in  the  measurement  process  of  physical 
phenomena.  An  investigation  of  both  the  issues  involved  and  the 
resulting  forms  of  measurement  has  potential  for  accounting. 

The  concept  acknowledges  measurement  difficulties  and,  therefore, 
uncertainties  with  regard  to  the  position  and  movement  of  subatomic 
particles.   The  conflict  in  classical  physics  between  the  wave  theory 
and  the  particle  theory  remained  unresolved  for  many  years.   Heisen- 
berg  (1958)  proposed  the  uncertainty  principle  which  states  that  it  is 
impossible  to  measure  simultaneously  with  perfect  accuracy  both 
position  and  momentum.   This  is  because  of  interaction  between  the 
observer  and  what  is  being  observed;  i.e.,  it  is  impossible  to  separate 
the  behavior  of  atomic  objects  from  their  interaction  with  the 
measuring  instruments. 

The  application  of  the  quantum  concept  to  accounting  seems 
obvious.   The  study  of  business  and  economy  does  not  deal  with  isolated 
systems.   If  what  is  reported  now  will  influence  the  future,  then  it 
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may  create  a  change  in  the  degree  of  uncertainty  in  the  forecasted 

earnings  value  itself.   In  terms  of  the  measurement  and  reporting  of 

earnings  as  well  as  the  production  of  forecasts  by  either  management  or 

the  concerned  researcher,  all  this  is  conjecture.   The  form  of 

interaction  possibly  could  be  explained  through  information  inductance 

or  as  self-fulfilling  prophecies. 

Types  of  Probabilistic  Data 

"The  concept  of  probability  has  always  been  elusive  and  lies  at 
the  heart  of  whatever  any  of  us  understand  by  statistical  theory  today" 
(Savage,  196A,  p.  175).   According  to  the  Laplacian  view,  all  knowledge 
has  a  probable  character,  simply  because  people  lack  the  requisite 
skill  and  information  to  forecast  the  future  and  to  know  the  past 
accurately.   Therefore,  a  degree  of  probability  is  a  measure  of  the 
amount  of  certainty  associated  with  a  belief.   Formal  logic,  as  a 
science,  investigates  the  rules  whereby  one  proposition  can  be  inferred 
necessarily  from  another.   By  applying  this  method  to  subjective 
probability,  it  is  possible  to  investigate  the  rules  whereby  the  degree 
of  one's  belief  of  a  proposition  varies  with  the  degree  of  one's  belief 
of  other  propositions  with  which  it  is  connected  (Venn,  1964,  p. 
19-20). 

What  about  the  measurement  of  a  probability  if  it  is  described  as 

a  degree  of  belief?  According  to  Venn: 

There  is  a  large  body  of  writers,  including  some  of  the  most 
eminent  authorities  upon  this  subject,  who  state  or  imply 
that  we  are  distinctly  conscious  of  such  a  variation  of  the 
amount  of  our  belief,  and  that  this  state  of  our  minds  can  be 
measured  and  determined  with  almost  the  same  accuracy  as  the 
external  events  to  which  they  refer  ....  we  have  a  certain 
amount  of  belief  of  every  proposition  which  may  be  set  before 
us,  an  amount  which  in  its  nature  admits  of  determination, 
though  we  may  practically  find  it  difficult  in  any  particular 
case  to  determine  it.  (1964,  p.  19) 
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A  system  which  derives  the  measurement  could  be  a  person,  a 

group  of  people,  a  mathematical  model,  computer  simulation,  or  any 
number  of  things.   I.J.  Good  calls  a  system  an  "org"  when  he 
defines  four  types  of  probabilities: 

(1)  Physical  (material)  probability,  which  most  of  us  regard 
as  existing  irrespective  of  the  existence  of  orgs.   For 
example,  the  unknown  probability  that  a  loaded,  but 
symmetrical-looking,  die  will  come  up  6. 

(2)  Psychological  probability,  which  is  the  kind  of 
probability  that  can  be  inferred  to  some  extent  from  your 
behavior,  including  verbal  communications. 

(3)  Subjective  probability,  which  is  a  psychological 
probability  modified  by  the  attempt  to  achieve  consistency, 
when  a  theory  of  probability  is  used  combined  with  mature 
judgment. 

(4)  Logical  probability  which  is  hypothetical  subjective 
probability  when  you  are  perfectly  rational,  and  therefore 
presumably  infinitely  large.  (1962,  p.  319-320) 

For  those  persons  who  have  been  exposed  to  an  axiomatic  definition  of 

probability,  the  relationship  of  the  above  to  these  axioms  is  that 

physical  probability  automatically  obeys  the  axioms,  subjective 

probability  depends  on  axioms,  psychological  probability  neither  obeys 

axioms  nor  depends  very  much  on  them.   There  is  a  continuous  gradation, 

depending  on  the  "degree  of  consistency"  of  the  probability  judgments 

with  a  system  of  axioms,  from  psychological  probability  to  subjective 

probability  and,  beyond,  to  logical  probability,  if  it  exists. 

According  to  Good,  "every  measure  of  a  probability  can  be  interpreted 

as  a  subjective  probability"  (p.  320).   For  example,  the  physical 

probability  of  a  six  with  a  loaded  die  can  be  estimated  as  eqtial  to  the 

subjective  probability  of  a  six  on  the  next  throw,  after  several 

throws.   Further,  if  one  becomes  aware  of  the  value  of  a  logical 

probability,  he  would  adopt  it  as  his  subjective  probability. 

Therefore,  a  single  set  of  axioms  should  be  applicable  to  all  kinds  of 


38 

probability  (except  psychological  probability),  namely  the  axioms  of 

subjective  probability.   Finally,  it  must  be  said  that  there  is  no  such 

thing  as  probability  in  the  abstract,  for  probability  only  exists  in 

relation  to  a  particular  body  of  knowledge. 

To  some,  the  use  of  the  word  "probability"  to  refer  to  both  a 

concept  and  the  index  number  by  which  that  concept  is  measured  is  akin 

to  circular  reasoning  or  using  a  word  in  its  own  definition,  but 

There  is  nothing  unusual  about  making  a  word  do  double 
service  in  this  way.  We  do  it  habitually  in  all  matters  of 
measurement.   Thus,  the  word  "length"  is  used  either  for  the 
abstract  concept  of  extension  in  space,  or  for  the  number 
which  measures  it.  (Fry,  1934,  p.  207) 

When  speaking  of  the  probabilistic  nature  of  accounting  earnings, 
one  is  concerned  with  formalizing  the  process  by  which  these  forecasts 
are  properly  reviewed.   Based  on  past  experience,  the  skilled  user  of 
financial  statements  already  possesses  a  notion  of  the  relative  size  of 
the  interval  around  the  point  estimate.   Therefore,  the  question  is 
whether  there  is  some  means  by  which  the  extent  of  uncertainty  about 
such  numbers  can  be  made  more  objective. 

We  have  emphasized  here  the  subjective  or  personal  judgmental 
aspects.   Savage  points  out,  "At  first  glance,  such  a  concept  seems  to 
be  inimical  to  the  ideal  of  scientific  objectivity,  which  is  one  major 
reason  why  we  statisticians  have  been  slow  to  take  the  concept  of 
personal  probability  seriously."  (1964,  p.  176) 

It  is  appropriate  to  mention  the  judgmental  influence  which  has 
always  existed  in  accounting  measurements.   Nothing  prohibits  the 
ultimate  results  of  a  reviewer's  mentation  from  being  either  objective 
or  subjective  as  long  as  it  is  based  on  the  information  available  at 
the  time.   If  the  final  result  contains  an  element  of  "degree  of 
belief,"  then  it  emphasizes  the  fact  knowledge  is  limited. 
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This  type  of  probability  is  not  new  to  accounting  (Toba,  1975,  p. 
11).   The  word  "probability"  refers  to  both  the  fundamental  concept  and 
the  index  number  by  which  that  concept  is  measured.   The  probability  of 
an  event  happening  is  an  estimate  of  one's  ignorance  about  the  event. 
Sometimes  it  is  important  to  view  uncertainty  about  an  event  as  the 
amount  one  does  not  know  rather  than  the  amount  that  is  known.   In  this 
way,  one  may  think  of  probability  as  the  degree  of  assurance  warranted 
by  a  state  of  partial  knowledge  or  lack  of  knowledge  (e.g.,  allowance 
for  doubtful  accounts  used  to  bring  the  valuation  of  accounts 
receivable  to  an  expected  value  and  bad  debt  expense  is  estimated). 

The  alternative  to  subjective  probability  is  the  relative 
frequency  approach,  which  is  based  on  observing  the  portion  of  outcomes 
of  one  type  in  an  infinite  number  of  experiments  to  determine  the 
numerical  value  of  a  particular  probability.   Accounting  has  few 
instances  which  occur  often  enough  under  similar  circumstances  to 
warrant  the  use  the  relative  frequency  approach.   However,  if 
accountants  could  rely  on  this  method,  then  the  benefit  would  lie  in 
its  being  relatively  more  objective  than  other  concepts  of  probability. 

The  interplay  between  the  concepts  of  objectivity  and  subjectivity 
in  statistics  is  interesting  if  sometimes  confusing.   Since 
frequentists  usually  strive  for,  and  believe  that  they  are  in 
possession  of,  an  objective  kind  of  probability  and  since  personalists 
declare  probability  to  be  a  subjective  quantity,  it  would  seem  natural 
to  call  frequentists  objectivists  and  personalists  subjectivists. 
Churchman  demonstrates  in  a  very  subtle  analysis  that  the  measurement 
of  relative  frequency  by  necessity  also  introduces  value  judgments: 
"the  operation  of  verifying  the  theory  of  sampling  is  based  on 
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judgment;  the  verification  of  a  theory  of  the  generation  of  events  is 

based  on  judgment"  (1961,  p.  168).  Whichever  means  is  chosen,  it  is 

essential  that  data  collected  under  the  other  be  adjustable.   Relative 

frequencies  must  agree  with  judgment  probabilities  and  judgment 

probabilities  must  agree  with  relative  frequencies  when  only  those  data 

are  available. 

In  order  to  maintain  relative  objectivity,  one  must  adhered  to 

specific  guidelines.   In  reporting  the  results  of  an  analysis  involving 

estimation  of  parameters,  it  is  important  to  provide  at  least  (1)  a 

detailed  discussion  of  the  stochastic  model  assumed  to  generate  the 

observations,  (2)  a  full  discussion  of  prior  assumptions  about 

parameter  values,  (3)  the  sample  information,  and  (4)  information  about 

posterior  probability  density  functions  (pdf)  for  parameters  of 

interest.   Of  course,  when  using  experimental  data  as  a  basis  for 

logical  inference,  one  must  mix  the  statistics  with  common  sense. 

When  the  honest  statistician  gives  you  an  indirect  answer,  it 
is  because  he  is  evaluating  the  experimental  evidence  common 
to  both  of  you,  and  allowing  you  to  add  the  common  sense  for 
yourself.   (Fry,  1934,  p.  213) 

When  reporting  the  results  of  analyses  of  scientific  studies,  the 
following  must  be  considered.   With  respect  to  the  stochastic  model  for 
the  observations,  subject  matter  considerations  should  be  reviewed  to 
justify  its  form  and  stochastic  assumptions.   In  the  case  of  earnings 
prediction,  if  theory  fails  to  specify  completely  the  relationship 
between  variables,  the  researcher  must  identify  properly  his 
assumptions  as  well  as  those  instances  where  judgments  are  employed. 

If  data-based  information  is  used,  then  this  fact  should  be  noted 
and  the  sources  of  the  information  should  be  provided.   If 
non-data-based  information  is  used,  it  should  be  examined  and 


41 
explicated  carefully.   In  this  way,  the  reader  will  understand  what 

information,  if  any,  is  being  added  to  the  sample  information.   For  the 

researcher  attempting  to  model  the  time-series  properties  of  earnings, 

it  would  be  beneficial  to  disclose  the  subjective  nature  of  the  process 

of  examining  the  autocorrelation  function  in  deriving  identified 

Box- Jenkins  (BJ)  firm-specific  models. 

Practical  Issues  in  Earnings  Forecasting 

The  Model  versus  the  Method 

This  section  discusses  the  source  of  forecast  accuracy 
differential  when  alternative  formulations  are  compared.   Basically 
there  are  two  reasons  for  this  difference:   one  involving  the 
functional  form  (the  method)  and  the  other  involving  the  specific 
variables  included.   Any  prediction  equation  is  based  on  a  specific  set 
of  statistical  procedures  which  is  the  method  employed  (for  instance, 
ordinary  least  squares  [OLS]  versus  least  absolute  value  [LAbsV] 
criterion).   Within  the  use  of  a  particular  method  there  also  exist 
differences  in  accuracy  resulting  from  the  set  of  specific  independent 
explanatory  variables  selected. 

A  method  describes  the  particular  procedures  which  are  to  be 
performed  and  how  they  are  to  be  performed.   The  statistical 
forecasting  method  determines  how  the  parameters  are  estimated  to 
develop  the  forecasting  equation  or  model.   The  components  of  the  model 
and  the  manner  in  which  they  are  determined  differ  with  each 
statistical  method.   However,  there  are  many  similarities  in  the 
resulting  models  across  methods.   The  end  product  may  be  capable  of 
being  expressed  mathematically  as  a  series  of  parameter  coefficients 
and  model  variables  not  unlike  linear  regression: 
Y  =  3^x^  +  3^X2  +  B3X3. 
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Although  it  resembles  OLS,  this  example  could  be  the  output  of  any 

method.   Once  determined,  the  model  itself  can  be  characterized 

independent  of  the  method  generating  it;  i.e.,  in  the  above  example, 

there  are  three  independent  variables.   The  differences  and 

similarities  among  methods  are  important  to  the  questions  of  fitting 

the  model  to  the  data  and  making  ex  ante  judgments  generally. 

Two  different  BJ  forecasting  equations  share  the  same  method,  but 

have  a  different  resulting  model.  An  OLS  regression  with  three 

independent  variables  and  an  OLS  regression  with  five  independent 

variables  are  two  different  models,  but  here  again,  they  share  the  same 

statistical  estimation  method.   A  forecast  using  a  parsimonious  BJ 

technique  versus  a  distributed  lag  with  macros  (DLWM)  would  be  a 

comparison  of  both  different  methods  and  different  models.   Comparing 

Foster's  (1978)  "model  5"  and  "model  6,"  as  mentioned  in  Chapter  Two, 

is  an  example  of  different  methods  (OLS  versus  ad  hoc),  but  the  same 

model : 

\  =  ^1  \-i   -«^-«    ^t  =  ^^VP- 

A  third  type  of  difference  is  possible.   This  difference  results 
from  a  data  availability  factor.   If  one  forecaster  has  information  not 
available  to  another,  then  there  can  be  a  difference  in  prediction  even 
if  both  use  the  same  model  and  the  same  method.   This  third  case 
concerns  information  availability  rather  than  information  use. 
Interaction  of  Economic  Events 

The  business  environment  can  be  viewed  either  as  the  economy  as  a 
whole  or  in  terms  of  some  segment  of  it.   Trends  in  the  general  economy 
or  the  future  course  of  the  industry  play  a  significant  role  in 
determining  future  performance  of  smaller  units.   Macro  forces  (e.g., 
the  level  of  economic  activity  and  other  prevailing  factors)  have  an 
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impact  on  the  individual  operations  at  the  microlevel.   The  extent  of 

the  influence  of  these  factors  depends  a  great  deal  on  the  industry 
involved.   Finns  from  one  group  may  be  affected  much  less  than  others 
by  overall  economic  trends. 

As  an  example  of  this  phenomenon,  consider  the  impact  of  the 
energy  crisis  on  various  industries.   Table  3-1  shows  the  ranking  by 
two-digit  Standard  Industrial  Classification  (SIC)  code  of  the  2XXX  and 
3XXX  code  groups  according  to  the  consumption  of  energy  in  a  recent 
year.   Obviously  there  is  a  great  divergence  just  among  the  subgrouping 
of  these  two  broad  industry  groups. 

Another  example  of  differential  economic  influence  is  the  change 
in  certain  financial  statement  items  as  a  result  of  accounting  for 
changing  prices.   Table  3-2  presents  the  specifics.   Among  all  the 
industries  presented  in  the  Arthur  Young  (1980)  study,  the  drug 
industry  has  the  smallest  impact  of  restatement.   On  the  other  hand, 
broadcasting,  airlines,  railroads,  and  tire  and  rubber  each  have 
impacts  of  restatements  of  more  than  100%.   Similar  results  hold  for 
the  percent  increase  in  net  assets  as  a  result  of  restatement.   Thus, 
"understanding  the  implications  of  major  economic  events  should  be  of 
considerable  value  in  attempting  to  forecast  earnings  changes" 
(Brealey,  1969,  p.  HI). 
Practical  Issues 

The  ability  to  predict  earnings  also  varies  considerably  depending 

on  the  industry  involved.   Gray  states: 

The  accuracy  of  forecasting  is  strongly  influenced  by  the 
nature  of  the  industry  to  which  the  firm  whose  results  are 
being  forecasted  belongs.   Certain  industries,  such  as 
automotive,  aerospace,  and  steel,  are  much  more  difficult  to 
forecast  than  other  industries,  such  as  food,  oil,  and  drugs. 
(1974,  p.  70) 
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Gray  also  summarizes  forecasts  made  by  security  analysts  for  ten 
industries  in  terms  of  mean  absolute  percentage  error  (MAbs%E).   The 
results  are  presented  in  Table  3-3.   This  is  a  double-edged  sword. 
Although  the  auto  industry  may  be  more  difficult  to  forecast  than  the 
other  industries  mentioned,  theoretically  it  reacts  the  most  to  the 
macro-economic  factors  contemplated  in  this  paper,  (see  Samuelson  1961, 
Chapter  14)  Therefore,  such  an  industry  is  of  particular  interest  to 
the  current  research  question. 

The  question  of  which  specific  forces  have  an  impact  also  is  an 
issue.  Appropriate  economic  variables  to  consider  are: 

(1)  Production  aggregates  (level  of  economic  activity) 

(a)  real  gross  national  product  (GNP);  levels  or  deviation 
from  trend 

(b)  real  personal  disposable  income  (PDI) 

(c)  real  gross  private  domestic  investment  (GPDI) 

(d)  index  of  industrial  production 

(2)  Measures  of  monetary  stimulus 

(a)  real  interest  rates   (interest  rate  -  X): 

(where  X  =  expected  inflation  or  actual  inflation) 

(b)  money  growth  relative  to  trend 

(c)  unanticipated  money  growth. 

The  theoretical  basis  for  selecting  GNP  is  rather  obvious:   it  is  a 
measure  of  overall  economic  activity.   The  industries  that  should  be 
affected  are  determined  primarily  by  which  industry's  profits  are  most 
sensitive  to  the  business  cycle,  (see  Samuelson,  p.  290-291)   Good 
candidates  are  capital  goods  and  consumer  durables.   GPDI  is  related  to 
the  profitability  of  industries  such  as  capital  goods  and  may  be 
indicative  of  the  profitability  of  cyclical  industries  in  general,  if 
one  believes  that  investment  demand  drives  the  business  cycle.   This 
idea  is  supported  by  Samuelson  (p.  281,  295  and  299)  as  well  as  by 
Ackley  (1961,  p.  337-338). 
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Other  forces  are  influential.   Brown  and  Ball  posit  that  "All 
firms  in  the  economy  are  affected  to  some  degree  by  monetary  policy  or 
changes  in  interest  rates"  (1967,  p.  56).   Economic  theory  supports  the 
notion  that  real  interest  rates  are  a  principal  determinant  of 
investment  demand.  As  such,  they  also  are  good  indicators  for  capital 
goods  industries.   PDl  is  thought  to  be  a  good  barometer  for  consumer 
expenditure,  thereby  affecting  consumer  goods  industries.   The  theory 
behind  the  idea  of  unanticipated  money  growth  is  more  recent.   Barro 
(1967)  presents  a  valuable  theoretical  study  of  this  topic.   He  argues 
that  only  unanticipated  movements  in  money  affect  real  economic 
variables.   "Moreover,  forecasts  of  such  macroeconomic  variables  are 
generally  available,  continuously  revised  on  the  basis  of  current 
information,  and  their  predictive  quality  is  being  extensively 
investigated"  (Lev,  1980,  p.  529). 

A  synthesis  of  the  economic  literature  results  in  a  selection  of 
possible  industries  and  relevant  economic  variables  for  each.   These 
industry/economic  variable  combinations  are  listed  in  Table  3-4.   Up  to 
this  point,  the  discussion  has  concentrated  on  the  influence  of 
macro-economic  factors.   The  theory  supporting  these  impacts  is 
relatively  strong.   As  a  result,  it  is  foreseen  that  macro  variables 
can  be  incorporated  easily  into  a  causal  model  to  predict  earnings.   On 
the  other  hand,  a  review  of  some  articles  on  the  use  of  micro  variables 
suggests  their  use  to  be  fruitless.   Never  the  less,  two  accounting 
studies  do  rely  tangentially  on  micro  theory  (Brown  and  Ball,  1967;  and 
Elliot  and  Uphoff,  1972),  although  as  Cyert  states,  "They  do  not 
develop  any  systematic  theory  but  rely  implicitly  on  propositions  of 
micro  and  macro  economics"  (1967,  p.  78). 
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In  general,  one  would  expect  a  firm's  level  of  activity  and, 
perhaps,  profit  to  be  dependent  upon  a  number  of  micro  factors  such  as 
the  following  among  others: 

(1)  Output  considerations 

(a)  product  mix  and  price  activity 

(b)  extent  of  vertical  integration 

(2)  Costs 

(a)  discretionary  expenditures  for  research  and 
development,  advertising,  etc. 

(b)  inventory  method,  since  LIFO  would  tend  to 
smooth  the  income  stream 

(c)  energy  consumption 

(d)  others 

(3)  Policies 

(a)  dividend  payout  ratio 

(b)  desire  for  growth,  etc. 

(c)  nonrecurring  events,  among  others. 

While  earnings,  in  the  short  run,  are  dominated  by  the  last  item — 
nonrecurring  events — the  others  on  the  list  (if  known  or  predictable) 
would  have  to  be  considered  in  any  prediction  model  which  incorporates 
micro-economic  factors.   The  problems  with  these  variables  lie  both  in 
both  their  predictability  and  in  lack  of  knowledge  as  to  the  mechanism 
by  which  they  might  impact  earnings.   Futhermore,  firm-specific  data  on 
these  variables  are  very  hard  to  acquire.   The  practicality  of  using 
micro-economic  variables  is  doubtful  since  "the  specification  of  a 
complete  economic  theory  of  the  firm  under  uncertainty  is  not  available 
presently  .  .  ."  (Lorek,  1979,  p. 191).   Therefore,  micro  variables  are 
not  considered  in  this  project. 

This  chapter  has  identified  a  number  of  issues;  the  next  chapter 
addresses  their  resolution.   To  the  extent  possible,  the  model 
formulation  seeks  to  follow  available  theory,  while  at  the  same  time 
avoiding  pitfalls  where  possible. 
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SIC 

Code 

Rani 

28 

1 

33 

2 

29 

3 

26 

4 

32 

5 

20 

6 

34 

7 

37 

8 

35 

9 

22 

10 

24 

11 

36 

12 

30 

13 

27 

14 

38 

15 

23 

16 

25 

17 

39 

18 

31 

19 

21 

20 

TABLE  3-1 

Industry  Ranking  by  Energy  Consumption 

Billions  kwh 
Equivalent  Purchased 

Industry  Fuels  &  Electric 

Chemicals,  allied  products  814.7 

Primary  metals  654.9 

Petroleum  and  coal  products  397.8 

Paper  and  allied  products  354.6 

Stone,  clay,  glass  products  339.8 

Food  and  kindred  products  268.8 

Fabricated  metal  products  107.6 

Transportation  equipment  101.9 

Machinery,  except  electrical  96.8 

Textile  mill  products  90.0 

Lumber  and  wood  products  67.2 

Electric,  electronic  products  66.7 

Rubber,  misc.  plastic  products  66.5 

Printing  and  publishing  25.5 

Instrument,  related  products  20.4 

Apparel,  other  textile  products  16.4 

Furniture  and  fixtures  13.6 

Misc.  manufacturing  13.1 

Leather,  leather  products  6.6 

Tobacco  products  5.5 


Source:  1975  Annual  Survey  of  Manufacturers 
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TABLE  3-2 
Selected  Industry  Impact  of  Restatement 

Frame  1  -  Impact  on  Income  from  Continuing  Operations (IFCO) 


Percent  Change  in 

IFCO  as  a  result  of 

constant  $  restatement 


Drugs 

25 

decrease 

Equipment 

28 

decrease 

Motor 

Vehicle 

38 

decrease 

All  non 

financial 

42 

decrease 

Percent  Change  in 

IFCO  as  a  result  of 

current  cost  restatement 

16  decrease 

39  decrease 

42  decrease 

49  decrease 


(Arthur  Young  and  Company,  1980,  p.  9) 


Frame  2  -  Purchasing  Power  Gain/Loss  as  %  of  Nominal  Dollar  IFCO 

Airlines  175%  gain 

Drugs  3%   loss 

Equipment  24%  gain 

Motor  Vehicle  21%  gain 

Utilities  135%  gain 

All  non-financial  39%  gain 

(Arthur  Young  and  Company,  1980,  p.  11) 
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TABLE  3-3 

* 
Gray  (1974)  Results 

Mean  Absolute  Percentage  Error 

by  Industry 


Percentage  Industry 

4.5%  Utilities 

6.0  Drugs 

7.0  Retail  Trade 

8.0  Paper  and  Containers 

8.5  Food  and  Household  Products 

12.0  Building  Construction 

13.5  Machinery 

17.0  Aerospace 

18.0  Automobiles  and  Parts 

29.0%  Metals 


* 


Reported  also  in  Abdel-khalik  and  Thompson  (A+T)  [1977-78,  p.  188.] 
"Forecasts  made  over  a  ten  year  period  by  security  analysts  employed  at 
a  large  brokerage  house"  (A+T,  p. 188). 
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TABLE  3-4 

Synthesis  of  Economic  Literature 

Industry  Variables* 

Capital  goods  industries 

Construction G,  V,  R,  S 

Materials M,  D,  S,  R 

Heavy  Equipment M,  D,  S,  R,  V 

Consumer  durables  industries 

Automobiles G,  V,  R,  S 

Appliances I,  M,  D,  S 

Consumer  goods  industries 

Retail  sales I,  D 

Services G 

Drugs None 


*Key: 

G  -  Gross  National  Product 

I  -  Personal  Disposable  ^ncome 

R  -  Real  Interest  Rate 

M  -  Unanticipated  Money  Growth 

D  -  Implicit  Price  Deflator  for  GNP 

V  -  Gross  Private  Domestic  Investment 

S  -  Money  Stock.(M2) 


This  table  was  compiled  with  the  assistance  of  Professor  William 
Baumberger,  Ph.D.,  Department  of  Economics,  University  of  Florida. 


CHAPTER  FOUR 
METHODOLOGY  AND  PRELIMINARY  INVESTIGATION 

This  chapter  describes  the  research  design  employed.   It  contains 

the  specification  of  the  earnings  models  utilized,  the  industries 

selected,  the  earnings  variable  chosen,  and  the  hypotheses  generated. 

The  chapter  is  organized  in  four  parts.   The  first  section  gives  a 

methodological  overview.   The  second  indicates  the  nature  and  sources 

of  the  data  used.   The  third  section  delineates  the  procedures  utilized 

in  the  annual  prediction  research,  and  the  last  contains  the  quarterly 

methodology.   As  the  procedures  are  described,  the  results  of  some 

preliminary  investigation  are  given. 

Overview  of  Research  Methodology 
A  causal  modeling  approach  is  taken  to  predict  income  before 
extraordinary  items  (IBEI)  on  both  an  annual  and  a  quarterly  basis. 
Forecasts  of  this  earnings  number  are  made  for  the  following  subset  of 
the  industries  discussed  in  Chapter  Three: 

Industry  Standard  Industrial  Classificatiion 

(1)  Drugs 2830 

(2)  Construction  Machinery  and  Equipment 3531 

(3)  Special  Industry  Machinery 3550 

(4)  General  Industrial  Machinery  and  Equipment 3560 

(5)  Motor  Vehicles,  car,  truck,  and  bus  bodies 3711  and  3713. 

The  forecast  accuracy  of  a  series  of  models  is  compared  to  help 
establish  the  value  of  both  the  causal  modeling  approach  and  the  use  of 

51 


52 
macro-economic  factors  in  earnings  prediction.  An  explanation  of  the 
particular  causal  modeling  approach,  the  distributed  lag  model,  is 
presented  first. 
Distributed  Lag  Methodology  Features 

The  primary  methodology  employed  is  an  auto-regressive,  time- 
series  regression  model.   Three  distinct  features  of  this  forecasting 
model  are  described  below. 

1.  The  model  contains  negatively  lagged  (hereafter,  lagged) 
values  of  the  earnings  variable  "on  the  right-hand  side".   The  model 
also  includes  exogenous  explanatory  variables,  including  a  time 
variable  and,  possibly,  powers  of  it.   The  results  of  this  formulation 
achieve  many  of  the  same  statistical  goals  of  pure  time-series  models 
in  that  (1)  stationarity  is  achieved  by  the  inclusion  of  the  time 
variables  instead  of  by  taking  differences  and  (2)  time-series 
properties  of  past  earnings  are  somewhat  captured,  depending  on  the 
selection  of  lags  of  dependent  variables.   The  method  is  similar  to 
naive  models  because  of  the  ad  hoc  selection  of  the  lags  and,  thus,  is 
unlike  the  data-determined  iterative  process  of  the  BJ  technique. 

2.  Most  importantly,  the  model  has  the  ability  to  contain  lagged 
values  of  macro-economic  variables  on  the  (explanatory)  right  side. 
These  exogenous  factors  are  included  because  of  their  causal  nature 
and,  hopefully,  for  their  predictive  ability.   In  order  to  accomplish 
both  of  these  objectives,  it  is  necessary  for  the  lags  to  be  "minus 
lags"  only.  In  other  words,  if  one  is  regressing  Y  on  a  set  of  right 
side  variables,  Xn,  then  the  only  appropriate  values  of  I   are  t-1,  t-2, 
t-3,  etc.   The  fact  that  the  X^^'s  are  lagged  in  this  way  gives  them  the 
capability  of  having  a  causal  (temporal)  impact  on  Y  .   However,  there 
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arises  the  question  of  predictability  if  the  forecast  horizon  exceeds 

the  smallest  lag.   In  this  case,  the  lagged  variables  must  themselves 

be  forecast  or  the  "forecast"  is  made  ex  post,  with  data  not  really 

available  at  the  time  the  forecast  is  desired.   In  the  present  study, 

only  negatively  lagged  variables  are  used  in  order  to  obtain  a  true  ex 

ante  forecast. 

3.  The  parameters  of  the  model  are  estimated  more  than  once  to 

eliminate  auto-regressive  tendencies  in  the  data.   The  model  is  fit 

using  ordinary  least  squares  (OLS)  resulting  in  parameter  coefficients 

which  are  efficient  and  unbiased.   The  general  form  of  the  resulting 

equation  looks  like: 


■t       ^^j   ^i't-i  ^  j^^   ^^^  ''k,A,t-j     „_ri 


p     ^  q 


i 


where:   i's  and  j's  are  lags  (up  to  m  and  n  lags  respectively), 

some  6,  .  and/or6   may  be  zero, 

X,  's  are  the  macros,  and 

Ji's  are  the  powers  of  the  time  variable,  t. 
The  resulting  model  becomes  a  distributed  lag  with  macros  (DLWM)  model. 

In  order  to  implement  this  methodology  and  make  statements  of 
relative  accuracy,  a  few  other  issues  relating  to  the  specific 
application  of  the  models  must  be  resolved.   As  seen  from  the  equation 
above,  the  possibility  exists  of  an  unlimited  number  of  lags  of  both 
endogenous  and  exogenous  variables.   In  this  study,  an  attempt  is  made 
not  to  overfit  the  model  and  thereby  to  try  to  capitalize  on  fitting 
the  model  to  the  data.   The  rationale  is  based  on  three  points:   (1) 
fewer  right  side  variables  allow  for  more  generalizability  to  other 
Industries  and  other  time  periods  ;  (2)  prudent  restriction  on  the 
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number  of  factors  incorporated  results  in  better  actual  predictability; 

and  (3)  correlation  coefficients  between  various  lags  of  the  various 

macros  (and  first  differences  of  macros)  indicate  multi-collinearity. 

All  choices  except  one  are  made  ex  ante;   that  is,  in  selecting 
lags  of  the  right  side  variables,  all  decisions  are  made  before  any 
predictions  or  any  comparisons  with  the  actual  are  made.   The  one 
exception  is  the  selection  of  the  powers  of  the  independent  variable 
time.   Previous  annual  studies  show  a  high  number  of  biased  predictions 
with  existing  time-series  models.   The  published  prediction  errors 
(predicted-actual)  are  mostly  negative,  indicating  underprediction  in 
most  cases.   This  underprediction  results  because  the  naive  models 
assume  a  linear  trend  which  does  not  capture  the  temporal  nature  of  the 
time  series.   The  general  increase  in  earnings  (1957-1977)  has  not  been 
linear  for  many  firms.   Instead,  it  has  been  somewhat  upward  curving. 
This  fact  is  confirmed  by  plotting  the  data  used  in  this  study. 
Updating  Process 

In  applying  the  distributed  lag  model  in  this  dissertation, 
"adaptive  updating"  has  been  chosen.   Prior  research  has  shown  the 
relative  accuracy  of  BJ  updating  techniques  from  best  to  worst  to  be 
(1)  reidentif ication  (not  a  possibility  for  the  parsimonious 
application  of  BJ  techniques),  (2)  reestimation,  and  (3)  adaptive 
forecasting.   The  DLWM  prediction  process  also  can  be  updated  by  either 
reestimation  or  adaptive  procedures.   Under  these  circumstances,  a  DLWM 
comparison  to  parsimonious  BJ  models  will  make  the  strongest  case  for 
the  latter  if  the  BJ  models  are  reestimated  and  the  causal  modeling 
approach  is  updated  using  adaptive  procedures.   Therefore,  one  can  make 
more  definitive  statements  as  to  the  value  of  the  model/macros  under 
these  circumstances. 
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All  forecasts  typically  are  made  for  periods  beyond  an  initial 
estimation  period.   The  data  available  in  this  estimation  period 
constitute  the  base  upon  which  forecasts  of  "future"  period's  earnings 
are  to  be  made.   However,  if  a  researcher  desires  to  make  forecasts  of 
one  year  ahead  at  more  than  one  point  in  the  future,  updating  the  data 
beyond  the  initial  data  base  is  required.   There  are  three  recognized 
updating  procedures:   reidentif ication,  reestimation,  and  adaptive 
forecasting.  All  three  rely  on  data  beyond  the  initial  base  period, 
but  vary  with  regard  to  the  extent  to  which  a  statistical  methodology 
is  reapplied.   Reidentif ication  is  the  most  severe  since  this  updating 
technique  has  the  possibility  of  changing  the  model  as  well  as  always 
requiring  reestimation.  Reestimation  alone  merely  requires  the 
parameter  coefficients  of  the  previously  established  model  to  be 
estimated  on  the  expanded  data  base. 

Adaptive  updating  requires  minimal  procedures.   No  reestimation 
takes  place.   An  additional  data  point  (actual)  is  compared  to  the 
forecast  already  made  for  that  point  in  time  (based  on  the  initial  data 
set).   The  difference  between  the  two,  a  new  residual,  is  used  in  the 
same  manner  as  other  residuals  are  used  in  that  particular  method. 
Prior  research  (see  McKeown  and  Lorek,  1978)  has  shown,  in  the  context 
of  BJ  forecasting,  that  reestimation  is  more  accurate  than  adaptive 
updating.   Reidentif ication  has  also  been  shown  to  be  more  accurate 
than  only  reestimating  for  those  who  deal  with  firm-specific  models. 
When  working  with  parsimonious  BJ  models,  reidentif ication  does  not 
apply. 
Model  Comparison  Statistics 

To  measure  forecast  accuracy,  a  comparison  statistic  is  required. 
As  described  in  each  of  the  following  sections  of  this  chapter,  various 
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model  forms  are  used  to  evaluate  the  DLWM  approach.   Forecasts  of  each 
model  are  obtained  for  each  firm.   The  relative  accuracy  of  the  models 
is  determined  by  comparing  the  ex  post  errors  of  each  model.   Three 
different  error  metrics  are  used: 
Let   E  =  error  (predicted  -  actual)  and  A  =  actual,  then 

n     2 
MSE  =1   2  (E.)    (mean  square  error) 
n  i=l  ^ 


MAbsE  =2  ^    I'^-i 
n  i=l 


n 
MAbs%E  =■  J,   2 
n  i=l 


(mean  absolute  error) 


(mean  absolute  percent  error) 


where  n  =  the  number  of  predictions  for  an  industry,  a 
forecasting  horizon,  etc. 

To  test  the  difference  between  means  of  any  two  models,  a  Wilcoxon 
matched  pairs  significance  test  is  performed.   The  test  hypotheses  are 
described  below. 
Hypotheses 

A  number  of  different  hypotheses  have  been  generated  for 

subsequent  empirical  testing.   Some  of  the  hypotheses  will  be  tested  by 

comparison  of  the  error  metrics  and  significance  tests.   Others  will  be 

addressed  without  significant  measures  provided.   Some  specific 

hypotheses  are  presented  in  subsequent  sections  of  this  chapter,  along 

with  the  procedures  used  to  test  them.   The  general  hypothesis  is: 

The  distributed  lag  model  with  macros  is  at  least  as 
accurate  as  relevant  models  from  the  literature. 

To  perform  hypothesis  testing,  the  following  stratifications  of 

the  data  are  considered: 
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(1)  Data  Base 

(a)  Annual  sample  //I 

(b)  Annual  sample  #2 

(c)  Quarterly  sample 

(2)  Industries:   2830,  3531,  3550,  3560,  and  3711/3713 

(3)  Horizons:  1-3  years  or  1-5  quarters 

(4)  Error  measures 

(a)  MSE 

(b)  MAbsE 

(c)  MAbs%E. 

For  192  of  the  strata  indicated  in  Table  4-1,  a  set  of  specific 
hypotheses  is  to  be  tested.   These  specific  hypotheses  depend  on  the 
sample  used  and,  therefore,  on  the  relevant  comparison  model  suggested 
by  the  literature.  An  "X"  in  the  table  indicates  that  ex  post  accuracy 
measurements  are  taken  for  each  model.   A  "W"  indicates  that,  in 
addition,  a  Wilcoxon  significance  measure  is  employed. 

If  the  following  assertions  hold,  the  value  of  the  causal  modeling 
approach  will  be  clearly  demonstrated: 

(1)  an  ex  ante  unconditional  DLWM  model  performs  as  well  as 
a  random  walk  with  drift  (RWWD)  in  predicting  annual 
earnings,  and 

(2)  an  ex  ante  unconditional  DLWM  model  performs  as  well  as 
univariate  BJ  models  in  forecasting  quarterly  earnings. 

If  the  influence  of  macro-economic  variables  on  earnings  is  in 
fact  a  causal  one,  then  predictions  based  on  actual  macros  should  be 
more  accurate  than  predictions  based  on  predicted  macros,  i.e.,  an 
unconditional  model  should  outperform  a  conditional  model. 

For  each  stratification  indicated  in  Table  4-1,  the  alternative 
hypotheses  for  annual  samples  #1  and  #2  are  (null  hypothesis  in  each 
case  is  "is  equally  accurate.": 
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Al;  DLWM  (unconditional)  is  at  least  as  accurate  as  RWWD 

A2:  DLWM  (ex  ante  conditional)  is  at  least  as  accurate  as  EWWD 

A3:  Distributed  lag  (DL)  without  macros  is  at  least  as  accurate 
as  a  RWWD 

A4:  DLWM  (unconditional)  is  at  least  as  accurate  as  DLWM 
(conditional) 

A5:  DLWM  (unconditional)  is  at  least  as  accurate  as  DL  without 
macros . 

For  sample  #1  only,  there  are  also  alternative  hypotheses: 

A6:  OLS  (with  macros  and  without  intercept)  is  at  least  as 
accurate  as  RWWD 

A7:  OLS  (with  macros  and  without  intercept)  is  at  least  as 
accurate  as  OLS  (with  macros  and  with  intercept). 

For  the  quarterly  sample,  the  alternative  hypotheses  are: 

Ql-4:  DLWM  (conditional)  is  at  least  as  accurate  as  each  of  the 
four  models  suggested  by  relevant  quarterly  research 

Q5-8:  DLWM  (unconditional)  is  at  least  as  accurate  as  each  of  the 
four  models  suggested 

Q9:   DLWM  (unconditional)  is  at  least  as  accurate  as  DLWM 
(conditional). 

Two  broad  categories  of  data  are  needed  to  test  these  hypotheses. 

The  first  is  the  object  of  prediction,  the  earnings  number.  Earnings 

before  extraordinary  items  has  been  chosen.  The  second  category 

includes  the  macro-economic  predictor  variables.   The  nature  and 

sources  of  these  data  are  described  below. 
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Nature  of  the  Data  Sets 

Annual  earnings  before  extraordinary  Items  data  are  taken  from 
Compustat  Annual  Industrial  (CAI)  tapes.   Earnings  data  for  1958 
through  1977  are  contained  on  the  1978  CAI  tape.  Earnings  for  1978  are 
taken  from  the  1979  CAI  tape  so  there  are  potentially  21  years  of  data 
available.   Two  samples  are  utilized  to  test  the  accuracy  of  the  annual 
prediction  models.   Both  samples  require  firms  to  be  listed  on  the  1978 
CAI  tape  and  to  have  earnings  figures  available  by  at  least  1964.  This 
cutoff  is  necessary  in  order  to  have  sufficient  observations  to  perform 
the  estimation  phase  of  model  construction.   It  is  assumed  that  the  set 
of  firms  contained  on  the  CAI  tape  is  representative  of  each  of  the 
industries  chosen. 
Experimental  Samples 

Annual  sample  #1.   The  1978  CAI  tape  lists  a  total  of  109  firms 
within  the  five  industry  groups  under  study  (85  capital/durable  goods 
and  24  drugs).   Only  19  of  the  24  firms  in  the  drug  industry  satisfy 
the  data  availability  requirement.   Likewise,  for  the  construction 
machinery  and  equipment  industry,  the  special  industry  machinery 
industry,  the  general  industrial  machinery  and  equipment  industry,  and 
the  motor  vehicles,  car,  truck,  and  bus  bodies  group:   there  are  9  of 
11,  20  of  22,  30  of  38,  and  13  of  14  firms,  respectively,  which  meet 
this  requirement.  (See  Table  5-5,  Frame  1)   Thus,  the  annual  sample  #1 
consists  of  91  firms,  72  of  which  are  in  the  capital/durable  goods 
industries.   See  Appendix  A  for  listing  of  the  firms. 

Annual  sample  #2.   A  subset  of  the  first  sample  is  taken  to  form 
annual  sample  #2.   This  new  sample  consists  of  all  9  firms  of  the 
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construction  machinery  and  equipment  industry  (3531);  a  random  sample 
of  10  firms  from  industrial  machinery  group  consisting  of  special 
industry  machinery  (3550)  and  general  industrial  machinery  and 
equipment  (3560);  and  all  13  firms  of  the  motor  vehicles,  car,  truck, 
and  bus  bodies  group  (3711  and  3713).   This  sample  has  been  selected  in 
order  to  conduct  extended  forecasting  on  capital /durable  goods  firms 
and  to  test  further  the  value  of  the  DLWM  approach.   A  list  of  these 
firms  is  contained  in  Appendix  B. 

Quarterly  sample.   The  1978  Compustat  Quarterly  Industrial  (CQI) 
tape  is  the  source  of  quarterly  earnings  before  extraordinary  items. 
Potentially  there  are  40  quarters  of  data  on  this  tape;  however,  data 
are  missing  at  both  ends.   The  first  quarter  listed  is  normally  the 
first  quarter  of  1968,  681.   The  last  quarter  listed  is  normally  771, 
so  that  37  quarters  typically  are  available. 

Because  of  a  peculiarity  of  one  of  the  quarterly  models  (to  be 
described  later),  it  is  necessary  for  all  firms  of  the  sample  to  have 
data  beginning  at  the  same  point  in  time;   thus,  cutoff  similar  to  the 
annual  sample  is  necessary.   In  order  for  a  firm  to  be  selected,  it 
must  have  data  as  of  the  beginning  of  the  tape,  i.e.,  681.  As  a  result 
of  this  criterion,  14  of  the  85  capital/durable  goods  firms  have  been 
omitted. 

The  resulting  71-firm  sample  consists  of  9  firms  from  the 
construction  machinery  and  equipment  industry,  18  firms  from  the 
special  industry  machinery  industry,  31  firms  from  the  general 
industrial  machinery  and  equipment  industry,  and  13  firms  from  the 
motor  vehicles,  car,  truck,  and  bus  bodies  group.   Appendix  C  contains 
a  listing  of  these  firms. 
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Macro  Economic  Data 

Real  GNP,  real  personal  disposable  income  (PDI),  and  gross  private 
domestic  investment  (GPDI)  are  available  quarterly  over  a  long  period 
of  time.   Interest  rate  data  likewise,  are  widely  available.  The  rate 
on  treasury  debt  of  various  maturities  is  available  on  a  weekly  basis 
through  the  Federal  Reserve  Bulletin.   The  rate  on  corporate  debt  of 
various  ratings  is  available  as  well.   The  above  macro  variables,  money 
stock  data,  and  a  listing  of  the  implicit  price  deflator  for  GNP  are 
available  in  Survey  of  Current  Business  and  1975  Business  Statistics. 

If  one  wishes  to  determine  a  real  rate  of  interest,  a  measure  of 
expected  inflation  must  be  subtracted  from  the  interest  rate.   One 
solution  is  to  subtract  the  actual  Inflation  rate.  A  theoretical  basis 
for  using  actual  inflation  as  a  measure  of  expected  inflation  is 
contained  in  Fama  (1975).   Another  way  to  measure  expected  inflation  is 
to  use  survey  data.   There  is  a  survey  of  economists,  businessmen,  etc. 
regarding  forecasts  of  future  inflation  which  has  been  collected  by  J. 
A.  Livingston  since  1947  and  is  contained  in  Carlson  (1977). 

Money  growth  is  available  on  a  monthly  basis  from  the  federal 
reserve,  and  Barro  has  calculated  unanticipated  money  growth  annually 
for  1941  to  1975.   Economic  Outlook  USA,  of  the  Survey  Research  Center 
of  the  University  of  Michigan,  has  on  a  quarterly  basis  (with 
projections  and  prediction  interval)  the  following:  GNP,  GPDI,  and 
personal  consumption  expenditures. 

In  this  study  the  major  sources  of  macro-economic  data  are  the 
Survey  of  Current  Business  (various  monthly  issues  through  June  1979) 
and  its  1975  statistical  supplement.  Business  Statistics  1975.   Other 
sources  include  Barro  (1977)  for  unanticipated  money  growth  and  Carlson 
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(1977)  for  expected  inflation.   Therefore,  the  following  variables  have 

been  collected: 

(1)  The  four  production  aggregates  are  real  gross  national 
product  (GNP),  real  personal  disposable  income  (PDI),  real  gross 
private  domestic  investment  (GPDI),  and  the  GNP  implicit  price  deflator 
(IPD),  where  1972  =  100. 

(2)  The  measures  of  monetary  stimulus  are  interest  rate  data, 
unanticipated  money  growth,  and  the  money  stock. 

For  nominal  interest  rate  data,  two  yields  on  U.S.  Government 
taxable  securities  have  been  obtained.   The  first  is  the  rate  on  three- 
month  new  issues  (INTM)  and  the  second  is  the  open  market  rate  on 
three-  to  five-year  issues  (INTY).   For  the  measure  of  the  money  stock, 
the  variable  "M2"  has  been  chosen,  defined  as  currency,  private  demand 
deposit,  and  bank  time  and  savings  deposits  (other  than  large 
negotiable  certificates  of  deposit).   For  a  measure  of  real  interest 
rates,  an  estimate  of  expected  inflation  is  subtracted  from  the  nominal 
rate  (INTY).   This  measure  of  inflation  is  obtained  from  J.  A. 
Livingston's  survey  of  economists  and  businessmen;  see  Carlson  (1977). 
The  availability  of  these  data  is  discussed  in  the  following  two 
sections. 

Annual  macro  data  set.   The  data  for  GNP,  GPDI,  PDI,  IPD,  M2, 
INTM,  and  INTY  are  gathered  for  the  period  1947  through  1978.   These 
figures  represent  the  revised  series  as  indicated  in  the  July  1977  (p. 
16)  and  July  1978  (pp.  24  and  36)  issues  of  the  Survey  of  Current 

Business. 

2 
Expected  inflation  data  are  gathered  for  1947  through  1977. 

Therefore,  real  interest  (RINT)  [=  INTY  -  expected  inflation]  is 
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available  1947  through  1977.   Unanticipated  money  growth  has  been 
obtained  for  1947  through  1975.   Since  data  for  1976-1978  might  be 
needed,  an  extrapolation  Is  conducted  to  generate  these  years 
artificially: 

\  =  Vt  ^  Vt  -^  ^Vt-1 

where  M  =  unanticipated  npney  growth, 

G  =  gross  national  product, 

I  =  personal  disposable  ^ncome,  and 

D  =  Implicit  price  deflator  for  GNP. 
Quarterly  macro  data  set.   The  quarterly  series  of  GNP,  GPDI,  PDI, 
IPD,  INTM,  and  INTY  have  been  obtained  for  the  first  quarter  1947  (471) 
through  the  first  quarter  1979  (791).  M2  is  obtained  for  the  period 
511-791.   Unanticipated  money  growth  does  not  have  a  qviarterly  series. 
Expected  inflation,  while  being  available  semiannually,  does  not  have  a 
quarterly  series.   The  sources  and  nature  of  the  earning  variables  are 
discussed  in  the  next  section. 

Research  Design 
Annual  Research  Design 

In  order  to  test  the  value  of  the  causal  modeling  approach  and 
specifically  the  DLWM  methodology,  a  number  of  further  specifications 
must  be  stated.   For  the  annual  study,  the  following  aspects  must  be 
determined : 

(1)  macro  exogenous  variables; 

(2)  lags  of  each  macro,  or  powers  of  time  variable; 

(3)  comparison  model(s); 

(4)  periods,  horizons,  bases,  industries  predicted; 

(5)  error  measures;  and 

(6)  significance  measures  and  sensitivity  checks. 
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Annual  DLWM  model.  As  discussed  previously,  the  distributed  lag 
methodology  is  quite  flexible  as  to  particular  model  form.   For  the 
purpose  of  the  annual  predictions,  three  macro-economic  factors  have 
been  chosen  as  exogenous  variables  and  only  the  first  negative  lag  is 
selected  for  each  of  these.   The  variables  selected  for  the  capital 
durable  goods  industries  are  real  GPDI,  real  interest,  and  money  stock 
(M2).   Two  macro-economic  variables  hare  been  selected  for  the  drug 
industry — GNP  and  PDI  in  their  first  lag  only.   These  choices  are  based 
on  economic  theory  which  indicates  the  influence  of  these  factors  [see 
Samuelson  (1961)  and  other  references  discussed  in  Chapter  Three]. 
This  negative  lag  has  been  chosen  because  of  the  causal  implications  of 
negative  lags  and  because  of  the  need  to  limit  the  number  of  terms  (to 
avoid  overfitting).   However,  the  judgments  made  are  somewhat  ad  hoc. 
The  model  itself  is  ex  ante  in  the  sense  that  the  model  form  is 
determined  in  advance  and  contains  only  negative  lags.   This 
formulation  eliminates  the  correlational  nature  of  contemporaneous 
approaches,  such  as  Lev  (1980)  and  others,  which  are  not  true  ex  ante 
forecasts. 

The  delineation  of  the  DLWM  model  requires  two  more  specifi- 
cations.  First,  both  the  first  and  the  second  power  of  the  time 
variable  is  used  to  capture  the  general  increase  in  earnings  over  time 
which  has  been  greater  than  linear.   Second,  a  problem  arises  as  to 
where  one  acquires  the  values  of  the  lagged  macro-variables  beyond  a 
one-year  prediction  horizon.   Since  these  ordinarily  are  not  known  at 
the  time  of  a  forecast  for  a  two  or  more  year  horizon,  either  the 
macros  are  predicted  prior  to  their  use,  or  in  a  research  setting, 
actuals  are  used  to  make  "predictions"  after  the  fact.   Predicting  in 
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both  these  ways  helps  to  isolate  the  factors  which  lead  to  good 
predictability:   "In  practice,  the  predictive  ability  of  an  econometric 
model  will  be  jointly  dependent  on  the  structure  of  the  model  and  the 
ability  to  forecast  the  exogenous  variables"  (Foster,  1978,  p.  123). 

In  order  to  evaluate  the  power  of  the  DLWM  methodology,  it  is 
necessary  to  separate  the  predictability  of  the  method  from  the 
predictability  of  the  macros.   Therefore,  two  DLWM  models  are  utilized 
throughout  the  research.   The  first  model  (unconditional),  PRWIO, 
incorporates  actual  values  of  the  macros.   The  second  model 
(conditional),  PRWll,  requires  independent  prediction  of  the  macros. 
The  forecasting  methodology  for  PRWIO  and  PRWll  requires  a  multi-step 
statistical  procedure.   This  technique  is  the  four-stage  least  squares 
suggested  by  Fuller,  Johnston,  and  Wallis  and  described  earlier  in  the 
chapter.  For  the  annual  model,  the  formalization  is  presented  in  Table 

4-2. 

Predicting  the  exogenous  macro-economic  variables.   In  order  to 
generate  predictions  based  on  the  PRWll  model,  the  values  of  the 
macro-economic  factors  for  horizons  of  two  years  or  more  themselves 
must  be  predicted.   Numerous  methods  are  available  for  such  prediction. 
Viewed  on  a  continuum,  these  methods  vary  from  extremely  sophisticated 
(assumed  to  be  most  accurate),  on  the  one  hand,  to  crude  (assumed  to 
lack  accuracy)  on  the  other.   If  it  were  possible  to  predict  perfectly 
the  macros,  one  would  have  PRWll  =  PRWIO.   Hence,  the  example  of  the 
accurate  extreme  is  PRWIO.   It  is  natural,  therefore,  to  select  a 
method  of  predicting  the  macros  for  PRWll  which  sets  this  model 
reasonably  apart  from  PRWIO.   Based  on  such  reasoning,  a  reasonably 
crude  method  of  predicting  the  macros  is  selected.   This  method  is  an 
extrapolative  regression: 
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TABLE  4-2 

Annual  Four  Stage  Least  Squares  for  PRWIO  and  PRWll 

stage  1: 

To  get  estimate  of  E   ,  regress 

E    =  f(t  t  t  M.    M.    intercept) 

Stage  2:  To  obtain  residuals,  regress 

2 
E  =  f(E   ,  t  t  M.    intercept) 
t      t-1       i^_^ 

then  generate  residuals:    z  =  E  -  E 
Stage  3:   To  obtain  estimate  of  rho,  regress   z  =  p*  z 

Stage  4;   To  obtain  efficient  estimates  of  the  coefficients,  make 
folowing  transformations  using  estimate  of  rho: 

*       "  2    2*  "     2 

Ej.  =  E^  -P  Vl  ^     '  ^     -P(t-l)^ 

1=1-P  t=t-P  (t-1) 

\=^i^-P^i^_^  <-l  =  V1-PV2 

Then  regress 

3  5         * 

E^  =  1  +  yE^  ,  +  Z  3.M.   +  Z  6,t^   ^  +5'z^  ,    and  set 
^  ^-^   i=l  ^  "t-1   i=4  ^  ^-^ 

p  = 5 +p.   Then  obtain  predictions  as  follows: 

^iQ7A  =  "YEiQ,.  +  2  3,M     +  3  T  +  3,T^  +  e.  +  p  •  z,_,- 

1976  1975   ._,  1  iiQTr   4     5      0       1975 

E--__  =  YE,-,,  +  2  6.M.    +  6.T  +  6_T^  +  e  +  P  •  z,-,_ 

1977  1976    ._.  1  i,q7f-    4     5      0       1975 

E  =YE  +Z6m  +6t+6t+3+P*z 

1978  ^1977       ^^^   i   ijg^^        4^  ^5       ^0  1975 


TABLE  4-3 
Annual  Models 
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Model 
ALM 

PRWIO 


Model  Type 

RWWD 

DLWM 
actual 
macros 


Last  Stage  Model  Form 


^t  =  ^t-1  ■"  ^Vi  -  %^/('-^^ 


^^t-1  +  ^0  +  ^4^  ^  ^5'     +  ^iy± 


Note 
1 

2 


t-1 


PRWll 


DLWM 

predicted 

macros 


E  =  YE    +  3q  +  S^t  +  3  t  +  Z  6  M 


PRW30 


DL 

with  out 

macros 


^t  =  ^Vl  ^  ^0  ^  ^1^  ^  ^2^ 


PRW40 


OLS  using 

ALM  time 

trend 


^t  = 


iQ+B^ALM^+  E6.M 

1=1    t-1 


PRW41 


OLS  using 

.^M  time 

trend 


E  -  ALM  =  Z  3.M. 

i=l   ^t-1 


PRW42 


OLS  using 

ALM  time 

trend 


E  -  ALM  =  Z  3,M. 
"^      ^   i=l  ^  ^t-1 


Notes ; 

1.  E  =  predicted  annual  earnings. 

2.  Albrecht,  Lookabill  and  Mckeown  model  from  their  Autumn  1977 
Journal  of  Accounting  Research  article. 

3.  The  M.    are  the  actual  values  of  macro  variables:   gross  private 

t-1   domestic  investment,  money  stock-M2  and  real  interest. 

4.  The  M     is  actual  value  for  the  1976  prediction  and  predicted 

t-1    values  for  the  1977  and  1978  predictions. 

5.  ALM  is  the  prediction  from  the  ALM  model.   Each  of  the  PRW4x  models 
is  "with  macros". 


6.   This  model  form  is  used  to  get  better  estimates  of  the  beta 

coefficients.   The  prediction  equation  would  be  of  the  same  form 
as  model  PRW40. 
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TABLE  4-4 
Annual  Sample  #1  Design 

Frame  1  -  Data  Availability 

Industry  Number      Number  of  Firms  in  Sample  1 

9 
20 
30 
13 


Capital/ 

3531 

Durable 

3550 

Goods: 

3560 

3711/3713 

times  years  predicted 

predictions 

less  missing  actuals 

72 

X  3 

216 

-  22 


194 


Drug:  2830  19 

X  3 


57 
-  3 


54 
Statistics  based  on  248  predictions. 


Frame  2  -  Years  Predicted 


Base  Period 
Ending 


Horizon 


1975  predicted:     1976    1977    1978 
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This  particular  model  has  been  chosen  because  plots  of  the  macros 
indicate  an  upward  sloping  graph.  Likewise,  a  log  function  could  have 
been  chosen.  The  predictions  are  within  10%  accuracy  based  on  absolute 
percent  error. 

There  are  two  more  reasons  for  choosing  a  crude  method  of 
predicting  the  macros.   First,  if  PRWll  (with  crude  macro  prediction) 
should  prove  to  be  more  accurate  than  a  RWWD,  then  stronger  conclusions 
can  be  made  with  respect  to  the  value  of  the  methodology.   Second,  in 
order  for  the  procedure  to  be  valuable  in  practice  (as  part  of  the 
reviewer's  ex  ante  analysis  of  management  forecasts)  it  must  be  easy  to 
apply  and  must  not  rely  on  unavailable  technology  or  models. 

Comparison  models.   As  stated  in  Chapter  Two,  the  consensus  of  the 
annual  earnings  prediction  literature  indicates  that  the  RWWB  model 
appears  to  exhibit  the  best  predictability.   Therefore,  a  particular 
form  of  this  model,  the  Albrect,  Lookabill  and  McKeown  (1977)  random 
walk  with  drift  model  (ALM) ,  has  been  selected  as  a  primary  comparison 
model : 

^^t  =  Vi^  [^Vi-^i^  /  ^^-2^^- 

As  defined  here,  the  drift  term  within  the  brackets  is  the  average 
increase  in  prior  years'  earnings  from  the  first  year  available  to  the 
previous  year,  t-1.  All  random  walk  methods  are  inherently  similar  in 
that  the  ex  post  errors  of  these  models  have  relatively  little  variance 
across  predictions.   As  a  result,  they  have  proved  accurate  across  many 
industries.   Among  the  other  strengths  of  the  ALM  model  are  its 
parsimonious  nature,  fewer  data  needs,  and  its  prevalence  in  the 
literature. 
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On  the  other  hand,  RWWD  models  have  the  following  drawbacks.   First, 
the  method  usually  underestimates.   Second,  the  methodology  could  be 
called  "seat-of-the-pants"  and,  therefore,  is  not  an  efficient 
statistical  procedure,  especially  with  regard  to  estimating  a  linear 
trend. 

In  addition  to  these  models,  five  other  models  hare  been  created. 
Four  of  these  and  the  original  three  are  listed  in  Table  4-3.  Another 
model,  PRW20,  is  so  numbered,  but  never  utilized.   This  model  is: 

3  ^ 
E  =  g  +  lit   +6  t^  +  Z  3^  M    . 
t    u    ^    D     i=I  ^  ^t-1 

That  is,  the  same  as  PRWIO  except  for  no  YE   ,.   The  PRW40  model  also 
is  excluded  from  the  analysis.   Essentially,  this  model  is  a  mechanical 
combination  of  ALM  with  macros.   This  model  and  PRW41  contain  the  same 
explanatory  variables.   PRW41  achieves  better  statistical  results  due 
to  a  more  efficient  estimation  of  the  3.'s. 

The  utilization  of  the  PRW30  model  is  important  to  this  research 
because  it  helps  to  isolate  the  causes  of  any  superiority  of  the  DU-JM 
models  which  ultimately  might  occur.   If  DLWM  models  are  better,  it 
could  be  due  to  the  nature  of  the  statistical  methodology  or  because 
DLWM  models  rely  on  a  larger  data  set  than  does  ALM  (inclusion  of 
macros  in  DLWM). 

Procedures  for  sample  //I.   Predictions  are  made  from  six  models 
based  on  the  first  annual  sample  and  ex  post  error  measures  are  taken 
over  a  three-year  holdout  period — 1976,  1977,  and  1978.   The  model 
parameters  are  estimated  using  an  18-year  base  period  (1958-1975). 
With  1958-1975  as  a  basis,  one-year-ahead  forecasts  of  1976,  two-year- 
ahead  forecasts  of  1977,  and  three-year-ahead  forecasts  of  1978  are 
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made  for  the  five  industries.   In  each  industry,  the  predictions  of 
each  of  the  six  models  are  generated,  except  no  PRWll  predictions  are 
produced  for  the  drug  industry. 

Accuracy  is  judged  on  the  basis  of  two  error  metrics:   MSE  and 
MAbsE.   In  both  cases,  a  series  of  stratifications  of  the  results  is 
employed.   (See  Table  4-1.)  Total  sample  error  means  are  calculated  as 
well  as  means  for  each  industry,  each  forecast  horizon,  and  each 
industry/horizon  combination. 

Because  of  the  possible  sensitivity  of  the  results  to  a  few  large 
errors,  prediction  sensitivity  procedures  are  conducted  based  on 
analysis  of  the  error  distributions  which  result.   This  is  a  check,  on 
the  sensitivity  to  a  few  large  errors.   No  significance  tests  are  run 
on  the  results  of  this  sample.   However,  bar  graphs  showing  the 
distribution  of  the  MAbs%E's  for  each  model  are  presented  in  Chapter  5. 

Since  data  are  missing  at  the  end  of  the  CM  tape  and  since  the 
years  1976-1978  are  predicted  in  all  cases,  all  ex  post  accuracy 
statistics  involving  the  use  of  the  actual  (i.e.  error  =  actual  - 
predicted)  are  based  on  the  predictions  which  have  an  accompanying 
actual  available.   The  breakdown  of  the  availability  is  shown  in  Frame 
1  of  Table  4-4. 

As  indicated  by  Frame  2  of  Table  4-4,  there  is  only  one  base 
period  (1975)  for  all  of  the  predictions  made  using  sample  #1  data. 
This  means  that,  among  other  things,  one-period-ahead  forecasts  predict 
only  1976  earnings.   The   results  of  sample  #1  should  be  highly 
sensitive  to  this  restriction.   Therefore,  it  is  necessary  to  have 
forecasts  generated  from  a  base  period  other  than  1975.   In  order  to 
accomplish  this,  another  annual  sample  is  chosen. 
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Procedures  for  sample  //2»   Because  of  base  period  sensitivity, 
further  testing  is  undertaken.  However,  only  four  models  are  now 
utilized  and  only  three  industry  groupings  are  involved.  A  second 
series  of  predictions  constitutes  the  major  annual  analysis  and  is,  in 
reality,  an  extension  of  the  forecasting  which  used  sample  #1.   The 
nature  of  the  extension  is  in  the  number  of  base  periods  used  to  make 
predictions.   Although  the  drug  industry  and  PRW40  and  PRW41  are  not 
included,  there  is  considerable  benefit  of  predicting  at  more  than  one 
base  period.   In  addition,  the  results  are  compared  more  easily  to 
other  research  which  utilize  ten  firm  samples  from  two-digit  SIC  code 
industry  groups  [e.g.,  Abdul-kader  (1979)].   The  analysis  also  can 
highlight  the  comparison  between  the  RWWD  and  the  two  DLWM  models. 

Three  sets  of  predictions  now  are  made.   First,  with  1975  as  a 
base,  1976,  1977,  and  1978  earnings  are  predicted.   Second,  with  1976 
as  a  base,  1977  and  1978  are  predicted.   And  third,  with  1977  as  a 
base,  1978  is  predicted.   This  gives  three  sets  of  one-year-ahead 
forecasts,  two  sets  of  two-year-ahead  forecasts,  and  one  set  of 
three-year-ahead  forecasts.   The  years  predicted  and  the  forecast 
horizons  involved  are  presented  in  Table  4-5,  Frame  2.   In  each  case, 
the  models  (ALM,  PRWIO,  PRWll,  and  PRW30)  are  fitted  in  the  base  period 
with  prediction  years  held  out. 

For  the  distributed  lag  models  (PRWIO,  PRWll,  and  PRW30),  the 
following  forecasting  procedures  are  used.   For  the  predictions  based 
on  1975,  the  model  parameters  are  estimated  using  data  from  1958-1975 
(18  years;  same  as  sample  #1).   For  the  predictions  based  on  1976,  data 
from  1958  to  1976  (19  years)  are  used.   The  final  set  of  predictions, 
based  on  1977,  are  generated  using  updated  1976  base  data,  i.e.,  the 
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models  are  not  reestimated  that  year;   the  updating  technique  used  is 
adaptive  forecasting.   Table  4-6  contains  the  prediction  equations  for 
the  PRWll  model. 

The  stratification  of  the  data  in  this  sample  is  somewhat  similar 
to  that  employed  in  annual  sample  #1.   However,  no  overall  sample 
results  are  calculated.   MSE,  MAbsE,  and  MAbs%E  are  calculated  for  each 
industry  group,  base  period,  and  forecast  horizon.   This  results  in  24 
strata  for  which  summary  error  statistics  are  calculated.   Of  these,  21 
are  subject  to  Wilcoxon  matched  pairs  significance  tests  based  on  MSE. 
(See  again  Table  4-1.)   The  sample  size  for  each  stratum  is  presented 
in  Table  4-5 ,  frame  1 . 

Annual  hypotheses.   Comparing  the  relative  performance  of  PRWIO 
and  PRWll  to  ALM  is  the  primary  purpose  of  the  research  conducted  here. 

Any  superiority  of  one  versus  the  other  can  be  attributed  to  either 
the  difference  in  method  or  the  difference  in  the  model.   If  ALM  proves 
to  be  more  accurate  than  PRWll,  then  another  possibility  exists;  that 
is,  the  need  to  predict  better  future  values  of  the  macro  variables 
used  with  PRWll.   Therefore,  two  other  comparisons  are  in  order. 
First,  a  comparison  of  PRWIO  and  PRWll  indicates  the  value  of  more 
accurate  prediction  on  the  macros  and  demonstrates  the  decline  in 
predictability  due  solely  to  their  prediction.   Second,  a  comparison  of 
PRWIO  and  ALM  directly  provides  the  answer  to  the  question  of  the  value 
of  the  DLWM  approach.   Any  difference  here  again  can  be  due  to  both 
differences  in  statistical  method  and  the  set  of  independent  variables 
utilized,  i.e.,  the  model. 

Other  comparisons  made  include:  PRWIO  versus  PRW30,  to  isolate  the 
value  of  the  macros  separate  from  any  difference  in  method;  and  PRW41 
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versus  ALM,  to  test  the  same  question.  Finally,  a  comparison  of  PRW30 
and  ALM  shows  the  value  of  the  distributed  lag  method  since  neither 
model  contains  macros.   These  comparisons  are  presented  graphically  in 
Figure  1  and  are  listed  below  in  accordance  with  the  numbering  system 
given  in  the  overview  to  this  chapter: 

Hypothesis 
Al:   PRWIO  is  at  least  as  accurate  as  ALM 
A2:  PRWU  is  at  least  as  accurate  as  ALM 
A3:   PRW30  is  at  least  as  accurate  and  ALM 
A4:   PRWIO  is  at  least  as  accurate  as  PRWU 
A5:   PRWIO  is  at  least  as  accurate  as  PRW30 
A6:   PRW41  is  at  least  as  accurate  as  ALM 
A7:   PRW41  is  at  least  as  accurate  as  PRW42 


Tests  for 

[value  of  DLWM  method] 

[difference  in  model 

and  method] 
[value  of  DL  approach] 

[goodness  of  macro 

prediction] 
[value  of  macros  only] 

[value  of  macros  only] 


[difference  in  esti- 
mating OLS  regression 
coefficients] 


Models  Without  Macros 


Models  With  Macros 


Distributed  Lag 
Methodology 


Non- 
Distributed  Lag 
Models 


PRW42 


Relationships  Between  the  Hypotheses  and  the  Models 
Figure  1 
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TABLE  4-5 
Annual  Sample  #2  Design 

Frame  1  -  Sample  Size  for  Each  Stratification  of  Annual  Sample  #2 


Base 

Horizon 

Industry  Group 
(number  of  firms) 

Period 
Ending 

3531 
(9) 

3550/ 
(10) 

3711/ 
(13) 

All 
(32) 

1975 

1 

9 

10 

13 

32 

2 

9 

9 

11 

29 

3 

_9^ 

_7_ 

M 

26 

All 

27 

26 

34 

87 

1976 

1 

9 

9 

11 

29 

2 

_9 

_7 

JLO 

26 

All 

18 

16 

21 

55 

1977 

1 

9 

7 

10 

26 

All 

1 

27 

26 

34 

87 

2 

18 

16 

21 

55 

3 

_8 

_7_ 

12. 

26 

All 

54 

49 

65 
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Frame  2  -  Years  Predicted  and  Horizons 

Horizon:     1 


Base  Period 

Ending 

1975 

1976 

1977 

1978 

1976 

1977 

1978 

1977 

1978 

77 


TABLE  4-6 

PRWl  1 
Prediction  Equations 

Parameters  estimated  on  data  1958-1975  (i.e.  Base  =  75): 
(one  year  hoi z on) 


E  =YE  +SSm  +6T  +  8    T  +  6      +  p       .    Z 

^1977  ^^^1976       ,    ,      i  i,„,,        4'       ^^5'       "^0       ^      '''1975 

i=l  1976 


(two  year  horizon) 


■1  /\      1 


(three  year  horizon) 


Parameters  reestimated  on  data  1958-1976  (i.e.  Base  =  76): 

^^1977   =  ^^1976  ^  J^  ^^i^,,,^  ^^  ^  ^^^'■^  ^^  ^  P*  •  ^1976 
(one  year  horizon) 


^978   =  ^^1977  ^  J^  ^i'^iigyy'"  ^^'  ^  ^5^^^  ^0  ^  ^   '  ^1976 
(two  year  horizon) 


Data  base  updated  for  1977  atualy  (i.e.  Base  =  77): 

^1978   =  ^^977  ^    .1^   ^^i^,,/  \^   +  33T  +  3,  +  P   .  Z^,,, 
(one  year  horizon) 
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Quarterly  Research  Design 

To  evaluate  the  generalizability  of  the  predictive  value  of  macro 
factors,  models  utilizing  quarterly  data  also  are  studied.   To  test  the 
hypotheses  listed  below,  six  model  forms  from  three  distinct 
methodologies  are  utilized.   A  quarterly  PRWIO  and  a  quarterly  PRWll 
are  generated  as  the  primary  models  for  study.   For  comparison 
purposes,  four  other  models  are  selected.   The  first  three  of  these  are 
the  parsimonious  BJ  models  of  Foster;  Brown  and  Rozeff ;  and  Watts- 
Griffin.   The  last  model  is  the  regression  equivalent  of  Foster's  BJ 
model,  which  was  suggested  by  him  in  his  book  as  well  as  in  his 
article. 

Quarterly  DLWM  models .   In  order  to  maintain  the  causal  nature  of 
the  models  (as  with  the  annual  study),  only  negatively  lagged  values  of 
the  macros  are  utilized.   Within  the  framework  of  the  DLWM  model  (and 
after  economic  theory  has  suggested  which  macros),  there  still  remain 
many  specification  alternatives  which  must  be  made  based  on  the 
researcher's  judgment.  While  a  macro-economic  variable  such  as  GPDI 
theoretically  does  affect  capital  goods  businesses,  predicting 
quarterly  earnings  using  quarterly  observations  of  macros  gives  rise  to 
the  question  of  time  needed  (allowed  by  researcher)  for  the  macro  to 
take  effect.   If  the  GPDI  of  a  year  ago  is  important,  then  the  model 
should  include  a  lag  of  t-4.   If  the  GPDI  of  the  preceding  year  is 
important,  then  possibly  the  sum  of  the  last  four  quarters  is 
appropriate.   Personal  judgment  is  required,  since  the  literature  does 
not  contain  the  necessary  refinement.   Three  basic  differences  between 
the  annual  and  quarterly  model  can  be  identified. 
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First,  for  the  quarterly  research  a  smaller  set  of  niacro  variables 
must  be  used  since  the  quarterly  data  base  consists  typically  of  37 
observations,  7  of  which  are  in  a  hold  out  sample.   There  is  serious 
concern  for  enough  data  points  to  estimate  properly  the  number  of  model 
parameters  needed  in  the  quarterly  DLWM  model;  hence,  the  least 
theoretically  supportable  macro  variable  is  omitted.   For  the  capital 
and  durable  goods  industries,  no  real  interest  variables  are 
incorporated  into  the  quarterly  model. 

Second,  for  the  causal  impact  of  GPDI  and  M2  fully  to  take  place, 
the  last  four  quarters  of  these  variables  are  summed.   In  order  for  the 
model  fitting  process  to  identify  turning  points,  a  t-2  lag  of  GPDI  is 
included  and  the  money  stock  (M2)  variable  remains  at  t-1  lag  as  in  the 
annual  work.   This  lag  combination  is  selected  judgmentally. 

The  remainder  of  the  model  includes  two  lags  of  the  dependent 
variable,  t-1  (the  previous  quarter)  and  t-4  (the  same  quarter  last 
year).   Both  time  and  time  squared  are  included  as  before.   For  the 
identity  of  the  particular  quarter  involved,  three  dummy  variables  are 
added.   Thus,  quarterly  earnings  are  a  function  of  time,  prior 
earnings,  the  quarter  being  predicted,  and  macro-economic  forces.   The 
complete  formulation  of  PRWIO  is  presented  below: 

/^       4  /s       4  2  ^ 

+  6,(  2  M,    )  +  6,  (  Z  M-    )  +  (  2  B^.M    ) 
^  i=l  ^t-i     ^   i=l  ^-i      i=l  ^^  ^t-i 

where  M  =  money  stock,  and  M  =  gross  private  domestic  investment. 

Prediction  of  quarterly  macro  variables.   As  with  the  annual 

formulation,  the  values  of  the  macro  variable  beyond  a  one-period-ahead 

horizon  must  be  predicted  independently  for  subsequent  use  in  the 


Model 

D  d  q 

P  D   Q 

BJ-F 

1    0   0 

0    1   0 

BJ-BR 

1   0   0 

0    1    1 

BJ-WG 

0    1    1 

0    1    1 
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horizon  must  be  predicted  independently  for  subsequent  use  in  the 

quarterly  version  of  PRWll.   The  manner  of  prediction  and  the  rationale 

are  the  same  as  that  of  the  annual  research.   The  macro  variables  are 

predicted  using  an  extrapolative  regression:   M  =  3,t  +  g  t  .   This 

somewhat  crude  prediction  methodology  allows  for  ease  of  application 

and  for  reasonable  differentiation  from  PRWIO  (where  the  values  of  the 

macros  are  supplied  ex  post  and,  therefore,  are  100%  accurate). 

Comparison  models.   Three  BJ  models  are  estimated  so  that 

comparison  accuracy  is  available  to  evaluate  the  predictions  of  the 

PRWIO  and  PRWll  models.   The  three  BJ  models  are  (in  the  customary 

notation) : 

Prior  work  by 
Foster  (earnings) 
Brown  and  Rozeff  (EPS) 
Watts-Griffin  (earnings) 

where  P  =  seasonal  auto-regressive, 
D  =  seasonal  differencing, 
Q  =  seasonal  moving  average, 
p  =  ordinary  auto-regressive, 
d  =  ordinary  differencing,  and 
q  =  ordinary  moving  average  parameters. 

The  prediction  equation  for  each  can  be  expressed  as 


BJ-F:    E^  =  Va+^I^Vi  "  Vs^  +  ^  "^  ^0 
BJ-BR:   E^  =  E^_^  +  *^(E^_^  -  E^_^)   +  a^  -  F^.a^_^ 

BJ-WG:   E^  =  E^.^  +  (E^_^  -  £^.5)  +  a^  -  e^-a^,^  -  6  ^.  a^_^  +  efV^.s 
where  <p      is  a  seasonal  auto-regessive  parameter, 
9-  is  deterministic  trend  constant, 

8.  is  seasonal  moving  average  parameter, 

9,  is  moving  average  parameter, 
and  the  a  's  are  disturbance  terms. 
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Each  model  is  fit  using  an  additional  drift  term,  although  Brown  and 

Rozeff  and  Watts-Griffin  did  not  use  one  in  their  original  research. 

The  last  comparison  model,  designated  FOST,  is 

E  =E   ,+6(E   ,-E   ,)+(S       where  5  is  a  drift  term, 
t    t-4      t-1    t-5 

Although  Foster  used  BJ  techniques  to  estimate  both  6  and  <5 ,  it  is 
possible  to  fit  this  model  using  OLS.   To  do  so,  one  must  regress 

[E^.E^_^-6]  =  3(E^.,  -  E^_3) 
with  the  proper  definition  of  the  drift  term,  6.  For  the  current 
research,  the  average  change  in  quarterly  earnings  is  used: 

where  i  =  1  for  first  quarter, 

=  2  for  second  quarter, 

=  3  for  third  quarter,  or 

=  4  for  fourth  quarter. 
The  analysis  proceeds  with  the  use  of  these  six  models. 

Procedures.   For  each  firm  for  each  model,  15  forecasts  are  made: 
a  set  of  5  forecasts  at  3  points  in  time.   One-,  two-,  three-,  four-, 
and  five-quarter-ahead  forecasts  are  made  with  752,  753,  and  754, 
respectively,  as  the  base  quarter.  Data  from  681  to  752  are  used  to 
make  the  original  estimate  of  the  parameter.   Then  updated  forecasts 
are  needed  for  those  based  on  753  and  754.   PRW  models  and  the  FOST 
model  are  updated  using  adaptive  forecasts.   BJ  models  are  reestimated 
each  time.  Thus,  the  first  set  of  predictions  is  based  on  data  from 
681-752  inclusive,  i.e.,  30  quarters.   The  second  set  is  based  on  31 
quarters  and  the  last  on  32  quarters.   The  15  forecasts  and  horizons 
are  listed  in  Table  4-7. 

For  each  stratification  of  the  quarterly  sample,  the  three  summary 
error  statistics  calculated  are  MSE,  MAbsE,  and  MAbs%E.   In  the  case  of 
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the  MSE  and  MAbs%E  calculations,  a  statistical  significance  of  the 
difference  between  models  is  also  determined.   This  measure  of 
difference  is  again  the  Wilcoxon  matched  pairs  test.   For  the  MAbs%E 
results,  bar  graphs  are  presented  in  Chapter  5  to  give  an  indication  of 
the  error  distribution  for  each  model. 

As  indicated  by  the  sample  size  data  of  Table  4-8,  missing  actuals 
exist  in  both  industry  3560  and  in  the  3711/3713  group.   For  industry 
3560,  there  are  two  fourth-quarter  1976  (764)  actuals  missing  and  three 
771  actuals  missing.   For  the  3711/3713  group,  there  are  two  missing 
actuals  in  both  quarters  764  and  771. 

Quarterly  hypotheses.   Based  on  the  information  contained  in  the 
three  individual  error  statistics,  the  quarterly  hypotheses  can  be 
formulated  and  tested.   The  following  nine  hypotheses  are  tested  many 
times  with  each  of  the  three  error  measures.   In  terms  of  the  notation 
used  in  this  section,  the  hypotheses  can  be  stated  as  follows: 

Hypothesis 
Ql:   PRWll  is  at  least  as  accurate  as  FOST. 
Q2:   PRWll  is  at  least  as  accurate  as  BJl. 
Q3:   PRWll  is  at  least  as  accurate  as  BJ2. 
Q4:   PRWll  is  at  least  as  accurate  as  BJ3. 
Q5:   PRWIO  is  at  least  as  accurate  as  FOST. 
Q6:   PRWIO  is  at  least  as  accurate  as  BJ-F. 
Q7:   PRWIO  is  at  least  as  accurate  as  BJ-BR. 
Q8:   PRWIO  is  at  least  as  accurate  as  BJ-WG. 
Q9:   PRWIO  is  at  least  as  accurate  as  PRWll. 


83 

Computing  Systems  Utilized 

The  majority  of  the  data  are  analyzed  using  the  Statistical 
Analysis  System  on  an  Amdahl  470  V/6-11  with  OS/MVS  release  3.8  and 
JES2/NJE  release  3.   Computing  uses  the  facilities  of  the  Northeast 
Regional  Data  Center  of  the  State  University  System  of  Florida,  located 
on  the  campus  of  the  University  of  Florida  in  Gainesville.  Additional 
computing  is  accomplished  using  the  Florida  State  University  Computer 
Center's  Control  Data  Corporation  cyber  170,  model  730  with  NOS 
operating  system.   The  results  of  these  calculations  are  presented  in 


the  next  chapter. 


Notes  to  Chapter  Four 


1.  Such  an  extension  would  not  necessarily  carryover  to  another 
industry  unless  its  "true"  model  was  quite  similar. 

2.  Carlson's  data  are  through  December  1975.   I  obtained  1976  and  1977 
data  from  Professor  William  Baumberger,  department  of  economics, 
University  of  Florida.   Data  beyond  1977  are  available  by 
contacting  Donald  Mullineaux  at  the  Federal  Reserve  Bank  of 
Philadelphia. 

3.  As  is  the  case  with  all  DLWM  forecasts,  the  final  term  in  the 
prediction  equation  uses  the  residual  from  the  last  year  of  the 
base  period.   For  a  1978  forecast  this  would  be  the  residual  from 
the  prior  year.   However,  the  data  set  used  to  generate  the 
estimate  of  the  parameter  coefficients  did  not  include  data  for 
1977,  so  that  there  is  no  residual  for  the  prior  year,  1977.   In 
order  to  have  a  one-step  ahead  forecast,  it  was,  therefore, 
necessary  to  artificially  gererate  this  residual.   This  process  of 
updating  is  basically  adaptive  forecasting  as  opposed  to 
reestimation. 
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TABLE  4-7 
Summary  of  the  Prediction  Quarters  and  Horizons 

Base  752  753  754 


Period 

681  -  752 

581  -  752 

681  -  752 

Updated  for 

753 

753  +  754 

Quarter 
Predicted 
(horizon) 

753(1) 
754(2) 
761(3) 
762(4) 
763(5) 

754(1) 
761(2) 
762(3) 
763(4) 
764(5) 

761(1) 
762(2) 
763(3) 
764(4) 
771(5) 

TABLE  4-8 
Sample  Size  for  Each  Stratification  of  the  Quarterly  Sample 


Indus 

try 

atif ication 

3531 

3550 

3560 

371X 

Industry 

135 

270 

458 

189 

Horizon  1 

27 

54 

93 

39 

2 

27 

54 

93 

39 

3 

27 

54 

93 

39 

4 

27 

54 

91 

37 

5 
Total 

27 
135 

54 
270 

88 
458 

35 
189 

Base  752 

45 

90 

155 

65 

753 

45 

90 

153 

63 

754 
Total 

45 
135 

90 

270 

150 
458 

61 
189 

The  number  of  firms  in  each  industry  is  9,  18,  31,  and  13  repectively. 


CHAPTER  FIVE 
EMPIRICAL  WORK  AND  RESULTS 

The  results  of  the  annual  and  quarterly  samples  appear  to 
indicate,  to  varying  degrees,  that  the  value  of  the  distributed  lag 
with  macros  (DLWM)  approach  has  been  established.   Accuracy 
measurements  are  not  consistent  across  industries  and  across  firms 
within  an  industry.   However,  the  number  of  times  that  one  of  the  two 
DLWM  models  is  more  accurate  than  the  comparison  model,  or  is  not 
significantly  less  accurate,  forms  a  large  portion  of  the  results.   The 
relative  accuracy  is  not  consistent  at  any  level — industry,  horizon,  or 
data  set — although  the  DLWM  model  generally  performs  worse  based  on  one 
error  metric,  mean  absolute  percent  error  (MAbs%E). 

With  so  many  specific  hypotheses  tested,  instances  can  be  found  in 
which  the  null  is  rejected  at  a  significant  level  amost  by  chance. 
Many  findings  of  one  stratification  are  contradicted  in  another  stratum 
which  share  many  of  the  same  characteristics.   Despite  the  mixed 
results,  it  is  possible  to  make  some  general  observations,  conclusions, 
and  trend  analyses.   Specific  results  are  discussed  below  according  to 
the  sample  to  which  they  pertain.   After  the  second  annual  sample 
results  are  presented,  a  preliminary  synthesis  is  offered.   Then,  the 
quarterly  results  are  delineated,  followed  by  an  overall  comparison  of 
the  findings  of  all  three  samples.   Final  conclusions  are  reserved  for 
Chapter  Six. 
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Annual  Sample  //I  Results 
Overview 

The  results  of  the  sample  //I  predictions  are  mixed.  While  there 
is  overall  indication  that  macro  forces  are  useful  in  predicting 
earnings,  the  specific  industry  results  show  this  is  not  always  the 
case.  Generally,  the  use  of  macro  factors  is  legitimated  in  the  mean 
square  error  (MSE)  metric  case,  although  not  with  the  DLWM  models 
(PRWIO  and  PRWU)  for  some  of  the  capital  goods  industries.   Even  for 
the  two  industries  (drugs  and  general  industrial  machinery  and 
equipment)  where  macro  factors  do  not  perform  well,  the  distributed  lag 
(DL)  model  without  macros  (PRW30)  outperforms  the  Albrecht,  Lookabill 
and  McKeown  (ALM)  model.   Due  to  large  standard  deviations,  most 
differences  in  MSE  should  not  be  significant. 

Originally  DLWM  models  were  compared  to  ALM  because  a  random  walk 
with  drift  (RWWD)  is  considered  the  best  annual  prediction  model 
according  to  current  literature;  never  the  less,  it  appears  the  ALM 
version  can  be  bettered  in  every  industry  studied.   Of  the  six  models 
compared  by  industry,  ALM  is  never  the  one  with  the  smallest  MSE, 
although  ALM  comes  in  a  close  third  in  the  Special  Industry  Machinery 
and  Equipment  Industry  (3550). 

A  frequency  distribution  for  absolute  percent  error  (Abs%E)  of 
each  of  the  six  models  is  presented  in  Figure  2.   The  vertical 
dimension  represents  the  number  of  predictions  from  the  capital /durable 
goods  industries  which  fall  within  the  19  ranges  of  Abs%E  plotted  on 
the  horizontal  axis.   Any  prediction  error  greater  than  300%  in 
absolute  value  is  not  plotted.   The  size  of  the  ranges  on  the 
horizontal  axis  changes. 
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Range 
Number 

1 

0? 

2 

2 

3 

4 

4 

6 

5 

8 

6 

10 

7 

20 

8 

30 

9 

40 

10 

50 

11 

60 

12 

70 

13 

80 

14 

90 

15 

100 

16 

125 

17 

150 

18 

175 

19 

200 

Legend  to  Figure  #2 
SCALE  FOR  HORIZONTAL  AXIS 


Range 

0%  or  more  -  but   les    than 


Width  of 

the  Range 

2% 

2% 

4 

2 

6 

2 

8 

2 

10 

2 

20 

10 

30 

10 

40 

10 

50 

10 

60 

10 

70 

10 

80 

10 

90 

10 

100 

10 

125 

25 

150 

25 

175 

25 

200 

25 

300 

100 

Figure  3 
Distribution  of  Signed  Percent  Error  for  Each  Annual  Model 
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Figure  3  presents  the  distribution  of  signed  percent  error  for 
each  model.  All  models  show  some  bias  toward  underprediction. 
Especially  in  those  cases  where  the  absolute  percent  error  (Abs%E)  is 
large,  the  signed  error  is  usually  negative,  indicating 
underprediction.  PRWIO  and  PRWU  are  the  two  models  with  a  number  of 
substantial  overpredlctions.   The  model  producing  the  smallest  bias  is 
PRW41. 
MSE  Results 

The  MSE  measures  of  the  six  annual  models  as  applied  to  sample  #1 
are  listed  in  Table  5-1.   Nine  groups  of  MSE  data  are  listed  in  this 
table.   The  first  frame  gives  the  total  sample  result  (based  on  248 
predictions  having  accompanying  actuals).   Overall,  PRWIO  has  the 
smallest  MSE  of  all  the  models;  except  for  a  lack  of  a  test  of 
significance  difference  of  each  two-model  comparison,  all  null 
hypotheses  but  one  are  rejected  in  favor  of  the  alternative  as  stated 
in  Appendix  D.   In  one  case,  hypothesis  A5,  PRW30  is  not  as  accurate  as 
ALM,  but  the  difference  in  MSE  (66111.975  versus  65052.135)  is  very 
small.   As  discussed  below,  these  results  are  dominated  by  extremely 
large  prediction  errors  in  the  auto/truck,  industry  (3711  and  3713). 

Specific  industry  results.   After  the  overall  sample  result  in  the 
first  frame,  specific  industry  results  are  listed  in  the  next  five 
frames  of  Table  5-1.   These  MSE  statistics  indicate  vast  differences 
across  industries. 

PRW30  clearly  is  the  most  accurate  of  the  models  in  industry  3531 
although  the  two  other  PRW  models  did  poorly  here.   In  addition,  PRWIO 
fares  worse  than  PRWll,  indicating  some  possible  model  misspecification 
for  this  industry.   All  null  hypotheses  except  A5  are  rejected  in  a 
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TABLE  5-1 
Mean  Squared  Error  for  Each  Stratum  of  Sample  #1 


Stratum 

Sample 

#1 

(obs=248) 


Model 

ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


Rank 

5 
1 
2 
6 
3 
4 


MSE 

65052.1 
27549.3 
36248.7 
66111.9 
38077.2 
43070.2 


Std.Dev  of  MSE 

452668. 
171062. 
266075. 
530349. 
319545. 
347488. 


Stratum 

Model 

Rank 

MSE 

Industry 

ALM 

2 

538.8 

3531 

PRWIO 

6 

36930.5 

(obs=27) 

PRWll 

5 

28229.0 

PRW30 

1 

289.4 

PRW41 

4 

2979.2 

PRW42 

3 

2343.1 

Industry 

ALM 

3 

78.684 

3550 

PRWIO 

5 

223.324 

(obs=57) 

PRWll 

6 

321.204 

PRW30 

4 

214.521 

PRW41 

1 

75.814 

PRW42 

2 

77.702 

Industry 

ALM 

2 

47.938 

3560 

PRWIO 

5 

103.288 

(obs=76) 

PRWll 

6 

104.843 

PRW30 

1 

35.491 

PRW41 

4 

61.258 

PRW42 

3 

53.506 

Industry 

ALM 

5 

472696. 

3711/13 

PRWIO 

1 

168220. 

(obs=34) 

PRWll 

2 

238418. 

PRW30 

6 

480749. 

PRW41 

3 

274271. 

PRW42 

4 

311164. 

Stratum   Model   Rank 


MSE 


Industry 

ALM 

4 

714.3 

2830 

PRWIO 

5 

1759.6 

(obs=54) 

PRWll 

N/A 

PRW30 

1 

510.2 

PRW41 

2 

527.8 

PRW42 

3 

556.8 

Horizon 

ALM 

5 

38118.9 

1 

PRWIO 

2 

9990.6 

(obs=91) 

PRWll 

2 

9990.6 

PRW30 

4 

31734.1 

PRW41 

1 

8141.9 

PRW42 

3 

22293.9 

Horizon 

ALM 

6 

74187.3 

2 

PRWIO 

2 

26198.3 

(obs=84) 

PRWll 

3 

28493.2 

PRW30 

5 

73240.4 

PRW41 

4 

29472.9 

PRW42 

1 

24052.6 

Horizon 

ALM 

4 

88114.5 

3 

PRWIO 

1 

50992.1 

(obs=73) 

PRWll 

2 

77905.6 

PRW30 

6 

100763.9 

PRW41 

3 

85294.6 

PRW42 

5 

90852.7 
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direction  opposite  to  that  argued.  For  industry  3550,  the  PRW41  model 
performs  best;  PRW42  and  ALM  are  very  close  behind.   The  alternative 
hypotheses  supported  are  A3,  A6,  and  A7;  A4  is  too  close  to  call;  and 
alternative  hypotheses  Al,  A2,  and  A5  are  rejected.   Thus,  the  value  of 
the  macros  is  established,  but  the  distributed  lag  methodology  is  not 
supported  here. 

In  the  case  of  industry  3560,  the  order  of  MSE  from  smallest  to 
largest  is  PRW30,  ALM,  PRW42,  PRW41,  PRWIO,  PRWU  so  that  alternative 
hypotheses  3  and  5  are  supported  and  Al,  A2,  A4,  A6,  and  A7  are  not. 
For  industry  3711/3713,  all  alternative  hypotheses  are  supported 
except,  as  was  the  case  with  the  overall  sample,  PRW30  is  not  as 
accurate  as  ALM  and  A5  is  not  supported.   Lastly,  the  relative  accuracy 
for  the  drug  industry  supports  alternative  hypotheses  A3,  A5,  A6,  and 
A7;  Al  and  A3  are  not  tested  and  alternative  hypotheses  A2  and  A4  are 
rejected. 

The  order  of  finish  from  best  to  worst  for  the  sample  and  for  each 
industry  is  summarized  in  Table  5-3,  Frame  I.   Table  5-1  contains  the 
results  for  each  prediction  horizon,  while  a  summarization  of  these 
findings  also  is  presented  in  Table  5-3,  Frame  2.   Generally,  the 
dominance  of  the  DLWM  is  portrayed  by  these  results.   In  fact,  as  the 
horizon  becomes  longer,  the  dominance  increases.   Consider  the  results 
of  the  capital/durable  goods  firms  presented  in  Table  5-6.  Again  the 
rankings  for  the  sample  support  all  alternative  hypotheses  except  A5; 
however,  the  means  now  are  higher.   The  prediction  accuracy  of  all 
models  for  the  drug  industry  is  higher  than  the  average  accuracy  of  the 
capital/durable  goods  which  tends  to  confirm  past  research.  More  to 
the  point,  these  results  confirm  the  theory  which  claims  the  drug 
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TABLE  5-2 
Summary  of  MSE  Results  for  Sample  #1 


Frame  1 

Industry 

Horizon 

(Obs) 

AU 

3531  (9) 

1 

C 

(9) 

2 

B 

(9) 

3 

(27) 

all 

C 

3550  (20) 

1 

B 

(19) 

2 

C 

(18) 

3 

C 

(57) 

all 

C 

3560  (30) 

1 

(27) 

2 

(19) 

3 

(76) 

all 

3711  (13) 

1 

+   (11) 

2 

2713  (10) 

3 

(34) 

all 

2830  (19) 

1 

C 

(18) 

2 

(17) 

3 

(54) 

all 

All  (91) 

1 

(84) 

2 

(73) 

3 

(248) 

all 

PRWIO 


Model 
PRWll    PRW30 


CODE:   B=Best  and  C=Second  best 


Frame  2 


B 


PRW41 


PRW42 


B 

C 

B 

C 
B 
C 
B 

C 
B 
C 

B 

B 

C 

C 

B 

B 

c 

C 

B 

B 

C 

C 

B 

B 

C 
N/A 

B 

N/A 

B 

C 

N/A 

B 

N/A 

B 

C 

c 

C 

C 

B 

C 

C 

C 

B 

B 

B 

Model  with 

Does  mc 

del 

Models  which 

Industry 

smallest 

MSE 

contain  macros 

are  close  second 

2830 

PRW30 

NO 

PRW41,  PRW42 

3531 

PRW30 

NO 

ALM 

3550 

PRW41 

Yes 

PRW42,  ALM 

3560 

PRW30 

No 

3711/13 

PRWIO 

Yes 

PRWll 
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TABLE  5-3 

Annual  Sample  #1 
Mean  Square  Error  Rankings  For  Each  Model 


Frame  1   Ranking 

Sample:       PRWIO,  PRWll,  PRW41,  PRW42,  ALM,  and  PRW30 


Industries: 
3531 
3550 
3560 
3711/13 
2830 


PRW30,  ALM,  PRW42,  PRW41,  PRWll,  and  PRWIO 

PRW41,  PRW42,  ALM,  PRW30,  PRWIO,  and  PRWll 

PRW30,  ALM,  PRW42,  PRW41,  PRWIO,  and  PRWll 

PRWIO,  PRWll,  PRW41,  PRW42,  ALM,  and  PRW30 

PRW30,  PRW41,  PRW42,  ALM,  and  PRWIO 

Ranking  by  Horizon 


Model 

jfo 

rizon  1 

Horizon  2 

Horizon  3 

ALM 

5 

6 

4 

PRWIO 

2 

2 

1 

PRWU 

2 

3 

2 

PRW30 

4 

5 

6 

PRW41 

1 

4 

3 

PRW42 

3 

1 

5 

Frame  2     Summary  of  Annual  Sample  #1  MSE  Results 

Model   Sample   Cap /Pur   3531   3550   3560  371X  2830   Horl  Hor2  Hor3 


ALM 

5 

5 

2 

3 

2 

5 

4 

5 

6 

4 

PRWIO 

1 

1 

6 

5 

5 

1 

5 

2 

2 

1 

PRWll 

2 

2 

5 

6 

6 

2 

N/A 

2 

3 

2 

PRW30 

6 

6 

1 

4 

1 

6 

1 

4 

5 

6 

PRW41 

3 

3 

4 

1 

4 

3 

2 

1 

4 

3 

PRW42 

4 

4 

3 

2 

3 

4 

3 

3 

1 

5 
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Industry  does  not  respond  to  the  impact  of  macro  forces.  While  all  the 
error  means  of  Table  5-6  are  higher  than  the  corresponding  mean  of 
Table  5-1,  the  major  finding  is  in  the  increased  superiority  of  the 
DLWM  models  in  terms  of  their  small  standard  deviations.   The  fact  is 
especially  true  upon  examination  of  the  relative  values  of  this 
statistic  at  each  of  the  three  horizons  as  presented  in  the  last  three 
frames  of  Table  5-6. 

The  predictive  performance  of  the  six  models  is  analysed  further 
in  Table  5-7  which  includes  MSE  calculations  at  each  horizon  within 
each  industry,  providing  more  insight  into  the  value  of  the  DLWM  models 
and  into  the  relative  performance  of  the  various  models.   For  industry 
2830,  individual  horizon  results  parallel  the  industry  findings,  but 
indicate  the  dominating  influence  of  high  MSE's  at  horizon  three  on  the 
overall  industry  figures.   The  horizon  three  data  in  industry  3531  are 
more  informative.  While  the  model  which  did  the  best  for  that  industry 
as  a  whole  is  PRW30,  this  would  not  have  been  the  case  if  the  horizon  3 
performance  of  ALM  were  not  so  bad.   Of  course,  this  is  one  indication 
of  the  weakness  of  ALM  at  longer  forecast  horizons.   For  the  other 
industries,  the  individual  horizons  results  are  similar  to  the  full 
industry  results  discussed  above. 

Table  5-7  is  summarized  further  by  the  contents  of  Table  5-2.   An 
ad  hoc  evaluation  of  the  relative  difference  between  model  MSE's  is 
conducted  to  determine  those  models  whose  performance,  while  not  the 
best  (B)  for  a  particular  stratifiction  of  the  sample,  is  a  close  (C) 
second  to  the  best  model.   These  results  indicate  the  random  nature  of 
findings  which  are  based  on  extremely  narrow  stratification 
(subsampling).   Although,  the  results  vary  considerably  as  to  the  best 
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two  models  for  these  stratum,  a  pattern  Is  established  with  respect  to 
the  performance  of  ALM.   This  model  is  never  best  at  the  industry 
level;  only  twice  among  the  24  substrata  is  it  best.   These  two  cases 
are  horizon  two  in  the  3531  industry  and  horizon  one  in  the  3550 
industry.  Also,  for  these  two  industries,  ALM  is  consistently  close  in 
performance  to  the  best  model  (PRW30  for  industry  3531  and  PRW41  in 
industry  3550). 

Sensitivity  of  MSE  results.   Any  MSE  statistic  is  sensitive  to 
large  errors.  When  predicting  earnings,  isolated  poor  predictions 
represent  weakness  in  the  relative  performance  of  a  given  model  among  a 
set  of  models.   In  any  event,  the  above  MSE  results  are  recomputed  on 
two  separate  bases  to  determine  the  extent  of  sensitivity  to  a  few 
extreme  errors. 

The  first  recalculation  is  made  with  no  prediction  error  larger 
than  $100  in  absolute  value;  these  results  are  presented  in  Table  5-8. 
The  overall  sample  now  shows  considerably  less  difference  among  models. 
This  result  is  obtained  with  the  elimination  of  18  large  predictions, 
14  of  which  are  in  industry  group  3711/3713  (three  in  3531  and  one  in 
2830).   Individual  Industry  results  similarly  are  very  close  in  the 
case  of  3531,  3711,  3713,  and  2830.   There  is  no  change  in  the  results 
for  industries  3550  and  3560  because  there  were  no  errors  greater  than 
$100  in  these  industries.   As  a  further  analysis,  individual  horizon 
results  for  three  industries — those  which  have  errors  greater  than 
$100 — are  presented  in  Table  5-9. 

The  second  method  of  counteracting  the  influence  of  a  few  large 
errors  is  to  scan  the  error  listing  and  to  eliminate  the  result  of  a 
few  firms  if  those  results  seem  clearly  to  be  outliers.   This  process 
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produces  the  data  presented  in  Table  5-10,  Frame  1.  After  eliminating 

eight  firms,  the  overall  sample  result  is  now  in  favor  of  the  ALM 
model.   However,  for  the  drug  industry  all  other  models  outperform  ALM. 
The  results  are  close  for  industry  3531,  because  the  same  three 
predictions  are  eliminated  (one  firm)  as  in  the  first  recalculation. 
PRWIO  is  still  better  than  ALM  in  the  3711/3713  group,  but  the 
difference  is  now  very  small. 

Among  the  most  interesting  of  the  findings  of  this  second 
sensitivity  check  are  those  located  in  horizon  results.   First,  PRW30 
shows  strength  in  all  horizons  and  second,  while  ALM  outperforms  PRWIO 
at  horizon  1  and  2,  it  does  not  at  horizon  3.   The  next  two  frames 
summarize  Frame  1.   Before  eliminating  a  few  large  prediction  errors, 
the  DLWM  models  did  poorly.   Based  on  the  new  figures,  the  relative 
performance  is  vastly  different,  as  can  be  seen  by  the  information  in 
Frames  2  and  3  of  Table  5-10. 

The  MSE  data  in  Frame  2  of  Table  5-3  indicate  clearly  the  value  of 
the  DLWM  models.   Specific  comments  concerning  this  frame  are  presented 
in  the  summary  of  the  annual  sample  #1  results  following  discussion  of 
the  mean  absolute  error  (MAbsE)  results. 
MAbsE  Results 

Specific  industry  results.   The  basis  of  discussion  thus  far  has 
been  the  error  metric  MSE.   Now  the  results  based  on  the  mean  absolute 
error  metric,  MAbsE,  are  given.   The  primary  results  based  on  MSE  are 
presented  in  Tables  5-1,  5-2,  5-3,  and  5-6  through  5-10.   These  tables 
are  paralleled  by  MAbsE  results  contained  in  seven  additional  tables, 
Tables  5-4,  5-5,  and  5-11  through  5-15. 


TABLE  5-4 
Mean  Absolute  Error  for  Each  Stratum  of  Sample  #1 
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Stratum 

Sample 

#1 

(obs=248) 


Model 

ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


Rank 

6 
3 

4 
5 
1 
2 


MSE 


52.078 
44.416 
47.887 
49.872 
40.494 
43.870 


Std.Dev  of  MAbsE 

250.18 
160.25 
184.64 
252.75 
191.27 
203.25 


Stratum 

Model 

ALM 

Rank 
2 

MSE 
12.480 

Stratum 
Industry 

Model 

Rank 

MSE 

Industry 

ALM 

4 

17.362 

3531 

PRWIO 

5 

67.341 

2830 

PRWIO 

5 

19.809 

(obs=27) 

PRWll 

6 

61.872 

(obs=54) 

PRWll 

N/A 

PRW30 

1 

10.196 

PRW30 

3 

15.257 

PRW41 

4 

21.554 

PRW41 

1 

13.709 

PRW42 

3 

19.537 

PRW42 

2 

14.372 

Industry 

ALM 

1 

4.580 

Horizon 

ALM 

5 

38.345 

3550 

PRWIO 

5 

8.101 

1 

PRWIO 

2 

27.826 

(obs=57) 

PRWll 

6 

9.318 

(obs=91) 

PRWll 

2 

27.826 

PRW30 

4 

7.358 

PRW30 

4 

33.051 

PRW41 

2 

4.649 

PRW41 

1 

22.049 

PRW42 

3 

4.908 

PRW42 

3 

32.101 

Industry 

ALM 

2 

4.009 

Horizon 

ALM 

5 

55.733 

3560 

PRWIO 

5 

6.839 

2 

PRWIO 

3 

44.982 

(obs=76) 

PRWll 

6 

6.998 

(obs=84) 

PRWll 

4 

45.378 

PRW30 

1 

3.891 

PRW30 

6 

55.942 

PRW41 

4 

4.887 

PRW41 

2 

40.871 

PRW42 

3 

4.718 

PRW42 

1 

38.118 

Industry 

ALM 

6 

325.736 

Horizon 

ALM 

4 

64.991 

3711/13 

PRWIO 

1 

210.164 

3 

PRWIO 

3 

64.444 

(0bs=34) 

PRWll 

2 

237.434 

(obs=73) 

PRWll 

6 

75.783 

PRW30 

5 

310.410 

PRW30 

2 

63.855 

PRW41 

3 

237.755 

PRW41 

1 

63.051 

PRW42 

4 

262.876 

PRW42 

5 

65.158 
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TABLE  5-5 

Annual  Sample  #1 
Mean  Absolute  Error  Rankings  For  Each  Model 


Frame  1   Ranking 

Sample:       PRWIO,  PRWll,  PRW41,  PRW42,  ALM,  and  PRW30 


Industries; 
3531 
3550 
3560 
3711/13 
2830 


PRW30,  ALM,  PRW42,  PRW41,  PRWll,  and  PRWIO 
ALM,  PRW41,  PRW42,  PRW30,  PRWIO,  and  PRWll 
PRW30,  ALM,  PRW42,  PRW41,  PRWIO,  and  PRWll 
PRWIO,  PRWll,  PRW41,  PRW42,  ALM,  and  PRW30 
PRW30,  PRW41,  PRW42,  ALM,  and  PRWIO 


Ranking  by  Horizon 


Model 

Ho 

rizon  1 

Horizon 

_2 

Horizon  3 

ALM 

5 

6 

4 

PRWIO 

2 

2 

1 

PRWll 

2 

3 

2 

PRW30 

4 

5 

6 

PRW41 

1 

4 

3 

PRW42 

3 

1 

5 

Frame  2     Summary  of  Annual  Sample  #1  MAbsE  Results 

Model   Sample   Cap/Dur  3531   3550   3560   371X  2830   Horl  Hor2  Hor3 


ALM 

5 

6 

2 

1 

2 

5 

4 

5 

6 

4 

PRWIO 

1 

2 

6 

5 

5 

1 

5 

2 

2 

1 

PRWll 

2 

4 

5 

6 

6 

2 

N/A 

2 

3 

2 

PRW30 

6 

5 

1 

4 

1 

6 

1 

4 

5 

6 

PRW41 

3 

1 

4 

2 

4 

3 

2 

1 

4 

3 

PRW42 

4 

3 

3 

3 

3 

4 

3 

3 

1 

5 
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The  first  of  these  tables  shows  the  MAbsE  statistics  for  the 
sample,  for  each  individual  Industry,  and  for  each  forecast  horizon. 
As  before,  the  DLWM  models  do  well  overall  and  in  industry  group 
3711/3713.   The  more  interesting  findings  of  the  table  appear  within 
the  specific  horizon  results.   The  relative  performance  of  PRWU  is 
substantually  worse  than  any  of  the  other  models  at  horizon  3.   Also, 
in  Industry  2830,  although  worst  in  performance  among  the  models,  PRWIO 
is  reasonably  close  in  MAbsE,  while  the  data  in  Table  5-1  show  it  to  be 
significantly  worse  than  any  other  model  for  this  industry. 

The  ALM  model  has  the  smallest  MAbsE  only  in  industry  3550.   PRW30 
is  the  best  in  industries  3531  and  3560;  PRW41  is  best  in  Industry 
2830,  horizon  1  ,  and  horizon  3;  and  PRW42  is  the  most  accurate  at 
horizon  2.   In  industry  3531,  both  DLWM  models  do  particularly  poorly, 
both  in  terms  of  MAbsE  and  in  the  magnitude  of  the  standard  deviation 
of  the  error  metric.  Additionally,  PRWU  is  more  accurate  than  PRWIO 
in  this  industry,  a  phenomenon  which  has  been  extremely  rare  in  annual 
sample  #1. 

One  final  comment  is  appropriate  with  regard  to  Table  5-4.   In 
comparing  Table  5-1  and  Table  5-4,  few  meaningful  differences  can  be 
found.   One  item  worth  mentioning  is  the  relative  standard  deviation  of 
ALM  and  PRWIO  at  horizon  3  in  the  two  tables.   The  difference  in 
standard  deviation  is  much  closer  in  the  MAbsE  data  of  Table  5-4. 

Results  for  the  capital/durable  goods  industries  alone  are  given 
in  Table  5-11.   The  MAbsE  data  in  this  table  are  considerably  different 
than  the  MSE  data  in  Table  5-6.   Based  on  MSE,  PRWIO  is  the  most 
accurate  model  in  all  four  categories.   However,  the  data  in  Table  5-11 
Indicate  that  PRW41  dominates  the  MAbsE  rankings.   The  relative 
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position  of  ALM  seems  to  be  essentially  the  same  across  these  two  error 

measures. 

As  a  further  analysis  of  the  MAbsE  data  for  sample  #1,  Table  5-12 
presents  the  results  by  industry/horizon  combination.   The  table  adds 
little  or  nothing  more  than  its  companion  MSE  table  (Table  5-7). 

Error  truncation  findings.   The  same  two  methods  of  sensitivity 
checking  applied  to  the  MSE  data  also  are  applied  to  the  MAbsE  results. 
Table  5-13  presents  the  sample  results,  industry  results,  and  the 
horizon  results  based  on  truncating  the  errors  at  $100.   The  findings 
of  this  table,  although  in  many  ways  different  than  those  of  Table  5-8, 
do  not  allow  for  any  general  conclusions  or  observations  relative  to 
the  performance  of  the  models  when  compared  to  each  other  or  when 
compared  to  the  truncated  MSE  data.   Likewise,  when  these  same  data  are 
examined  further  in  industry/horizon  combinations  such  as  those  listed 
in  Table  5-14,  it  is  difficult  to  find  useful  information  present  in 
these  data. 

The  other  procedure  to  counteract  the  effect  of  a  few  unusually 
large  errors  results  in  the  MSE  Table  5-10,  Frame  1;  a  similar  result 
is  given  by  the  MAbsE  data  of  Table  5-15.   The  industry  data  (3531, 
3550,  and  2830)  which  are  presented  here  produce  the  same  relative 
performance  as  the  MSE  data. 
Summary  of  Annual  Sample  //I 

Since  the  MAbsE  statistics  generally  offer  no  new  information  or 
insight  into  the  relative  performance  of  the  models,  a  summary  based  on 
MSE  is  appropriate.   Table  5-3,  Frame  2  presents  the  rankings  of  the 
various  models  according  to  ten  different  stratifications  of  the  data. 
The  following  observations  can  be  made  with  regard  to  the  annual 
hypotheses: 
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Hypothesis 

Al 
A2 
A3 
A4 
A5 
A6 
A7 


Observation 


PRWIO  outperforms  ALM  6 

PRWll  outperforms  ALM  5 

PRWIO  outperforms  PRWll  7 

PRWIO  outperforms  PRW30  4 

PRW30  outperforms  ALM  7 

PRW41  outperforms  ALM  7 

PRW41  outperforms  PRW42  7 


times  out  of  10 

times  out  of  9 

times  out  of  8 

times  out  of  10 

times  out  of  10 

times  out  of  10 

times  out  of  10. 


ALM  performed  best  only  once — in  industry  3550,  but  PRW41  (at  4.649)  is 
very  close  to  ALM  (4.580).   Thus,  the  prediction  performance  of  the 
suggested  DLWM  models  is  substantiated  in  the  sample. 

TABLE  5-6 
Mean  Squared  Error  for  Each  Stratum  of  Capital/Durable  Goods  Firms 


Stratum 


All  Capital/Durables 


Model 


Rank 


MSE 


Horizon  1 


Horizon  2 


Horizon  3 


ALM 

194 

5 

82960.6 

PRWIO 

194 

1 

34727.8 

PRWll 

194 

2 

45848.8 

PRW30 

194 

6 

84372.2 

PRW41 

194 

3 

48529.1 

PRW42 

194 

4 

54903.8 

ALM 

72 

5 

48152.3 

PRWIO 

72 

2 

12588.3 

PRWll 

72 

2 

12588.3 

PRW30 

72 

4 

40071.1 

PRW41 

72 

1 

10263.5 

PRW42 

72 

3 

28151.5 

ALM 

66 

6 

94301.5 

PRWIO 

66 

2 

33109.1 

PRWll 

66 

3 

36029.8 

PRW30 

66 

5 

93086.7 

PRW41 

66 

4 

37411.8 

PRW42 

66 

1 

30507.6 

ALM 

56 

4 

114347.9 

PRWIO 

56 

1 

65100.8 

PRWll 

56 

2 

100184.6 

PRW30 

56 

6 

131060.1 

PRW41 

56 

3 

110830.2 

PRW42 

56 

5 

118052.3 

TABLE  5-7 
Mean  Square  Error  for  Each  Industry/Horizon  Combination 
Stratum        Model     Rank       MSE      Std.  Dev.  of  MSE 
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Industry  3531 

ALM 

1 

228.047 

481.55 

Horizon  1 

PRWIO 

5 

7973.405 

23428.91 

PRW30 

2 

262.976 

714.37 

PRW41 

4 

6095.923 

17972.36 

PRW42 

3 

4452.903 

13235.35 

Horizon  2 

ALM 

1 

85.400 

129.74 

PRWIO 

6 

30698.951 

91854.46 

PRWll 

5 

23788.149 

71023.19 

PRW30 

2 

468.992 

1276.37 

PRW41 

4 

2667.383 

7786.58 

PRW42 

3 

2384.911 

6984.14 

Horizon  3 

ALM 

4 

1302.969 

3191.59 

PRWIO 

6 

72119.418 

215816.20 

PRW30 

1 

136.401 

142.59 

PRW41 

2 

174.439 

222.79 

PRW42 

3 

191.466 

241.63 

Industry  3550 

ALM 

1 

20.801 

56.97 

Horizon  1 

PRWIO 

5 

166.673 

522.16 

PRW30 

4 

41.643 

104.72 

PRW41 

2 

23.600 

64.22 

PRW42 

3 

29.303 

56.06 

Horizon  2 

ALM 

3 

67.220 

205.11 

PRWIO 

4 

121.360 

231.75 

PRWll 

5 

193.571 

467.91 

PRW30 

6 

350.962 

1269.10 

PRW41 

1 

61.119 

163.51 

PRW42 

2 

62.018 

168.14 

Horizon  3 

ALM 

3 

155.098 

379.82 

PRWIO 

5 

393.899 

1046.85 

PRWll 

6 

627.630 

1717.34 

PRW30 

4 

262.586 

574.88 

PRW41 

2 

149.341 

335.34 

PRW42 

1 

148.034 

332.89 

Industry  3560 

ALM 

2 

31.521 

71.85 

Horizon  1 

PRWIO 

5 

79.963 

155.05 

PRW30 

1 

19.211 

41.48 

PRW41 

4 

55.806 

136.45 

PRW42 

3 

40.778 

85.90 

Horizon  2 

ALM 

2 

45.585 

87.48 

PRWIO 

6 

114.771 

272.66 

PRWll 

5 

109.589 

267.75 

PRW30 

1 

34.253 

59.36 

PRW41 

4 

66.494 

134.16 

PRW42 

3 

61.829 

118.50 

Table  5-7  continued 
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Stratvim 

Model 
ALM 

Rank 
4 

MSE 

Std.  Dev.  of  MSE 

Horizon  3 

77.201 

236.09 

PRWIO 

5 

123.801 

248.16 

PRWll 

6 

137.382 

227.41 

PRW30 

3 

62.955 

133.52 

PRW41 

2 

62.429 

146.96 

PRW42 

1 

61.774 

142.47 

Industries 

ALM 

5 

266427.299 

719597.06 

3711  and  3713 

PRWIO 

2 

63759.036 

156632.35 

Horizon  1 

PRWll 

2 

63759.036 

156632.35 

PRW30 

4 

221642.158 

717193.57 

PRW41 

1 

52458.743 

155143.19 

PRW42 

3 

152694.523 

467487.87 

Horizon  2 

ALM 

6 

565511.336 

1299628.81 

PRWIO 

1 

173045.882 

396762.75 

PRWll 

3 

196112.886 

457866.50 

PRW30 

5 

557446.753 

1426750.24 

PRW41 

4 

222020.043 

464197.13 

PRW42 

2 

180835.944 

374595.13 

Horizon  3 

ALM 

4 

638750.156 

1492083.18 

PRWIO 

1 

298713.221 

647129.06 

PRWll 

2 

512010.478 

1156900.72 

PRW30 

6 

733221.412 

1960612.66 

PRW41 

3 

620104.993 

1441836.56 

PRW42 

5 

660537.253 

1535905.37 

Industry  2830 

ALM 

2 

97.800 

145.00 

Horizon  1 

PRWIO 

5 

146.854 

269.86 

PRW30 

4 

141.395 

245.91 

PRW41 

3 

102.495 

277.09 

PRW42 

1 

96.812 

294.06 

Horizon  2 

ALM 

3 

435.447 

743.72 

PRWIO 

5 

858.950 

2270.14 

PRW30 

4 

470.365 

1044.81 

PRW41 

1 

363.466 

1034.37 

PRW42 

2 

383.983 

1076.20 

Horizon  3 

ALM 

4 

1698.601 

2372.78 

PRWIO 

5 

4515.972 

13898.51 

PRW30 

1 

964.701 

1701.64 

PRW41 

2 

1177.354 

1946.38 

PRW42 

3 

1253.946 

1902.21 
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TABLE  5-8 

Sensitivity  Test  1  on  MSE  Results 

Mean  Squared  Error  for  Each  Stratum  of  Sample  #1 
Absolute  Error  less  than  $100 


Stratum 

Sample 

#1 

(ob8=-230) 


Model 

ALM 

PRWIO 

PRWU 

PRW30 

PRW41 

PRW42 


Rank 

2 

4 
6 
1 
5 
3 


MSE 


340.897 
389.465 
492.583 
282.210 
390.642 
375.718 


Std.Dev.  of  MSE 

1072.8 
1284.4 
1739.7 
854.9 
1649.4 
1579.1 


Stratum 

Model 

Rank 

MSE 

Industry 

ALM 

4 

137.232 

3531 

PRWIO 

5 

141.870 

(obs=24) 

PRWll 

6 

198.335 

PRW30 

1 

64.310 

PRW41 

3 

107.275 

PRW42 

2 

79.699 

Industry 

ALM 

3 

78.664 

3550 

PRWIO 

5 

223.324 

(obs=57) 

PRWll 

6 

321.204 

PRW30 

4 

214.521 

PRW41 

1 

75.814 

PRW42 

2 

77.702 

Industry 

ALM 

2 

47.938 

3560 

PRWIO 

5 

103.288 

(obs=76) 

PRWll 

6 

104.843 

PRW30 

1 

35.491 

PRW41 

4 

61.258 

PRW42 

3 

53.506 

Industry 

ALM 

3 

1565.87 

3711/13 

PRWIO 

2 

1409.07 

(obs=20) 

PRWll 

4 

2242.31 

PRW30 

1 

1118.16 

PRW41 

6 

2618.71 

PRW42 

5 

2444.53 

Stratum   Model   Rank 


MSE 


Industry  ALM 


2830 
(obs=53) 


Horizon 

1 

(obs=85) 


Horizon 

2 

(obs=78) 


Horizon 

3 

(obs=67) 


PRWIO 
PRWll 
PRW30 
PRW41 
PRW42 


ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


672.966 
705.870 

N/A 
492.012 
489.090 
511.626 


141.249 
229.666 
229.666 
111.615 
243.888 
186.936 


272.480 
347.526 
372.931 
317.596 
348.206 
337.728 


673.707 
641.019 
965.433 
457.441 
626.225 
659.446 
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TABLE  5-9 

Sensitivity  Test  1  on  MSE  Results 

Mean  Square  Error  for  Each  Industry/Horizon  Combination 
Absolute  Error  Less  Than  100 


Stratum 

Industry  2830 
Horizon  1 


Horizon  2 


Model 


Rank 


MSE 


Std.Dev.  of  MSE 


Horizon  3 


Industry  3531 
Horizon  1 


Horizon  2 


Horizon  3 


ALM 
PRWIO 

2 

5 

97.800 
146.854 

145.007 
269.861 

PRWll 
PRW30 
PRW41 
PRW42 

N/A 
4 
3 
1 

141.395 

102.495 

96.812 

245.917 
277.092 
294.069 

ALM 
PRWIO 

3 
5 

435.447 
858.950 

743.724 
2270.146 

PRWll 
PRW30 
PRW41 
PRW42 

N/A 
4 
1 
2 

470.365 
363.466 
383.983 

1044.817 
1034.372 
1076.203 

ALM 
PRWIO 

5 
4 

1623.185 
1197.487 

2429.466 
2521.126 

PRWll 
PRW30 
PRW41 
PRW42 

N/A 
1 
2 
3 

932.722 
1089.499 
1147.815 

1752.171 
1975.102 
1911.905 

ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 

3 
5 
5 

1 
4 
2 

72.197 
164.048 
164.048 

25.018 
105.541 

41.149 

123.257 
212.264 
212.264 

28.577 
223.718 

53.597 

ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 

5 
4 
6 
1 
3 
2 

96.031 
80.801 
113.800 
43.983 
72.052 
56.981 

134.446 
66.103 

151.232 
62.772 

102.341 
75.314 

ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 

5 
4 
6 
1 
3 
2 

243.467 
180.761 
317.158 
123.928 
144.231 
140.968 

308.650 
340.991 
646.142 
147.093 
217.589 
201.247 

Table  5-9  continued 
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Stratum 


Model 


Rank 


MSE 


Std.Dev.    of  MSE 


Industry  3711/3713 

ALM 

2 

1027.150 

2066.664 

Horizon   1 

PRWIO 

3 

1210.831 

2640.584 

PRWU 

3 

1210.831 

2640.584 

PRW30 

1 

648.929 

1020.837 

PRW41 

5 

1974.078 

4201.182 

PRW42 

4 

1488.939 

3409.244 

Horizon  2 

ALM 

4 

1689.854 

2220.450 

PRWIO 

1 

932.478 

1441.826 

PRWll 

2 

1013.391 

2297.771 

PRW30 

3 

1393.492 

1525.830 

PRW41 

6 

2847.450 

5187.606 

PRW42 

5 

2687.920 

4946.908 

Horizon  3 

ALM 

3 

2160.178 

2501.399 

PRWIO 

2 

2149.998 

3263.412 

PRWll 

6 

4846.562 

6595.713 

PRW30 

1 

1468.485 

1760.731 

PRW41 

4 

3249.493 

5505.165 

PRW42 

5 

3475.293 

5685.851 
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TABLE  5-10 
Sensitivity  Test  2  on  MSE  Results 


Frame  1  -  Mean  Square  Error  for  Each  Stratum  of  Sample  #1, 
Outlier  Firms  Eliminated 


Stratum 


Model 


Rank 


MSE 


Std.Dev  of  MSE 


Sample 

ALM 

1 

475.619 

1543.7 

#1 

PRWIO      5 

680.861 

3005.3 

(obs=224) 

PRWl 1      6 
PRW30      3 
PRW41      2 
PRW42      4 

708.136 
575.844 
522.744 
587.645 

2809.8 
2634.5 
1919.7 
2372.7 

Stratum 

Model 
ALM 

N 
4 

MSE 

Stratum 
Industry 

Model 
ALM 

_N 
5 

MSE 

Industry 

137.232 

709.044 

3531 

PRWIO 

5 

141.870 

2830 

PRWIO 

1 

321.146 

(obs=24) 

PRWll 

6 

198.335 

(obs=48) 

PRWll 

N/A 

PRW30 

1 

64.310 

PRW30 

2 

504.418 

PRW41 

3 

107.275 

PRW41 

3 

529.606 

PRW42 

2 

79.699 

PRW42 

4 

550.830 

Industry 

ALM 

2 

82.319 

Horizon 

ALM 

1 

179.000 

3550 

PRWIO 

4 

97.291 

1 

PRWIO 

5 

566.087 

(obs=54) 

PRWll 

5 

127.497 

(obs=83) 

PRWll 

5 

566.087 

PRW30 

6 

223.362 

PRW30 

2 

243.378 

PRW41 

3 

79.592 

PRW41 

3 

338.936 

PRW42 

1 

81.598 

PRW42 

4 

490.383 

Industry 

ALM 

2 

29.877 

Horizon 

ALM 

1 

477.074 

3560 

PRWIO 

5 

72.062 

2 

PRWIO 

5 

648.053 

(obs=73) 

PRWll 

6 

81.629 

(obs=76) 

PRWll 

4 

548.830 

PRW30 

1 

26.240 

PRW30 

6 

655.082 

PRW41 

4 

51.123 

PRW41 

2 

481.945 

PRW42 

3 

40.507 

PRW42 

3 

484.811 

Industry 

ALM 

1 

2503.39 

Horizon 

ALM 

3 

852.679 

3711/13 

PRWIO 

5 

4927.15 

3 

PRWIO 

4 

865.781 

(obs=25) 

PRWll 

6 

5024.14 

(obs=65) 

PRWll 

6 

1075.788 

PRW30 

3 

3570.25 

PRW30 

5 

907.730 

PRW41 

2 

3242.76 

PRW41 

1 

805.157 

PRW42 

4 

3836.66 

PRW42 

2 

832.078 

no 


Table  5-10  (continued) 


Frame  2  -  Summary  of  MSE  Results,  Outlier  Firms  Eliminated 


Model  with      Does  Model 
Industry   smallest  MSE   contain  Macros 


3531 
3550 
2830 


PRW30 
PRW41 
PRWIO 


No 

Yes 

Yes 


Close 
Second 


Number  of 
Firms  omitted 


PRW42  One 
PRW41,  ALM  One 
PRWl 1        Two 


Specific  data  from  Frame  1 
Industry 

3531 
3550 
2830 


Model 

MSE 

Std.Dev. 

ALM 
PRWIO 

137 
141 

212 
228 

ALM 
PRWIO 

82 
97 

254 
20 

ALM 
PRWIO 

709 
321 

1590 
825 

Ill 


TABLE  5-11 
Mean  Absolute  Error  for  Each  Stratum  of  Capital/Durable  Goods  Firms 


Stratum 


All  Capital/Durables 


Horizon  1 


Horizon  2 


Horizon  3 


Model 

ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


ALM 

PRWIO 

PRWll 

PRW30 

PRW41 

PRW42 


Rank 


MAbsE 


194 

6 

61.741 

194 

2 

51.265 

194 

4 

55.703 

194 

5 

59.507 

194 

1 

47.949 

194 

3 

52.080 

72 

5 

46.480 

72 

2 

33.112 

72 

2 

33.112 

72 

3 

39.563 

72 

1 

26.222 

72 

4 

39.029 

66 

5 

66.731 

66 

3 

52.503 

66 

4 

53.006 

66 

6 

67.046 

66 

2 

48.894 

66 

1 

45.257 

56 

3 

75.481 

56 

1 

73.145 

56 

6 

87.926 

56 

4 

76.264 

56 

2 

74.769 

56 

5 

76.903 
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TABLE  5-12 

Mean  Absolute  Error  for  Each  Industry/Horizon  Combination 

Stratum        Model        Rank        MAbsE    Std.Dev.  of  MSE 


Industry  3531 

ALM 

2 

9.481 

12.46 

Horizon  1 

PRWIO 

5 

38.917 

85.24 

PRW30 

1 

8.938 

14.35 

PRW41 

4 

32.448 

75.32 

PRW42 

3 

27.078 

64.68 

Horizon  2 

ALM 

1 

6.736 

6.71 

PRWIO 

6 

65.396 

172.41 

PRWll 

5 

59.102 

151.10 

PRW30 

2 

11.827 

19.24 

PRW41 

4 

22.218 

49.45 

PRW42 

3 

20.985 

46.77 

Horizon  3 

ALM 

4 

21.224 

30.96 

PRWIO 

5 

97.711 

265.31 

PRWll 

6 

87.597 

225.63 

PRW30 

1 

9.822 

6.70 

PRW41 

2 

9.997 

9.15 

PRW42 

3 

10.549 

9.49 

Industry  3550 

ALM 

1 

2.664 

3.79 

Horizon  1 

PRWIO  • 

5 

6.713 

11.31 

PRW30 

4 

3.761 

5.38 

PRW41 

2 

2.716 

4.13 

PRW42 

3 

3.410 

4.31 

Horizon  2 

ALM 

3 

4.410 

7.10 

PRWIO 

4 

6.781 

8.92 

PRWll 

5 

8.003 

11.69 

PRW30 

6 

8.638 

17.07 

PRW41 

I 

4.277 

6.72 

PRW42 

2 

4.379 

6.72 

Horizon  3 

ALM 

1 

6.889 

10.67 

PRWIO 

5 

11.037 

16.97 

PRWll 

6 

13.602 

21.64 

PRW30 

4 

10.003 

13.11 

PRW41 

3 

7.190 

10.16 

PRW42 

2 

7.131 

10.14 

Industry  3560 

ALM 

2 

3.285 

4.63 

Horizon  1 

PRWIO 

5 

6.110 

6.64 

PRW30 

1 

2.652 

3.54 

PRW41 

4 

4.528 

6.04 

PRW42 

3 

4.277 

4.82 

Horizon  2 

ALM 

2 

4.425 

5.19 

PRWIO 

6 

7.188 

8.09 

PRWll 

5 

7.101 

7.83 

PRW30 

1 

4.244 

4.10 

PRW41 

4 

5.341 

6.27 

PRW42 

3 

5.193 

6.01 
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Table  5-12  continued 

Stratiun        Model 


Rank 


MAbsE 


Std.Dev.  of  MAbsE 


Horizon  3 

ALM 

1 

4.563 

7.71 

PRWIO 

5 

7.496 

8.44 

PRWll 

6 

8.255 

8.54 

PRW30 

4 

5.345 

6.02 

PRW41 

3 

4.810 

6.44 

PRW42 

2 

4.738 

6.44 

Industries 

ALM 

5 

239.187 

476.08 

3711  and  3713 

PRWIO 

2 

132.018 

224.03 

Horizon  1 

PRW30 

4 

201.025 

443.09 

PRWAl 

1 

108.140 

210.14 

PRW42 

3 

182.298 

359.74 

Horizon  2 

ALM 

6 

376.396 

682.80 

PRWIO 

I 

232. 15A 

362.03 

PRWll 

2 

238. A29 

391.39 

PRW30 

5 

367.261 

681.77 

PRWAl 

4 

25A.689 

415.77 

PRW42 

3 

23A.060 

372.36 

Horizon  3 

ALM 

3 

382.524 

739.68 

PRWIO 

1 

287.564 

489.92 

PRWll 

2 

373.379 

643.42 

PRW30 

5 

390.075 

803.50 

PRWAl 

4 

387.628 

722.53 

PRW42 

6 

399.326 

746.15 

Industry  2830 

ALM 

3 

7.518 

6.60 

Horizon  1 

PRWIO 

4 

7.793 

9.53 

PRW30 

5 

8.373 

8.67 

PRW41 

2 

6.236 

8.19 

PRW42 

1 

5.848 

8.12 

Horizon  2 

ALM 

4 

15.408 

14.48 

PRWIO 

5 

17.408 

24.26 

PRW30 

3 

15.228 

15.89 

PRW41 

1 

11.453 

15.68 

PRW42 

2 

11.945 

15.98 

Horizon  3 

ALM 

4 

30.433 

28.64 

PRWIO 

5 

35.782 

58.63 

PRW30 

1 

22.981 

21.53 

PRW41 

2 

24.452 

24.81 

PRWA2 

3 

26.469 

24.24 
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TABLE  5-13 

Sensitivity  Test  1  on  MAbsE  Results 

Mean  Absolute  Error  for  Each  Stratum  of  Sample  #1 
Absolute  Error  Less  Than  100 


Stratum 

Model 

Rank 

MAbsE 

Std 

Dev.  of  MAbsE 

Sample 

ALM 

4 

9.402 

15.925 

#1 

PRWIO 

5 

10.904 

16.485 

(obs=230) 

PRWll 

6 

11.861 

18.800 

PRW30 

2 

9.264 

14.045 

PRW41 

3 

9.265 

17.497 

PRW42 

1 

9.165 

17.117 

Stratum 

Model 

ALM 

Rank 

4 

MAbsE 
8.295 

Stratum 
Industry 

Model 

Rank 

MAbsE 

Industry 

ALM 

5 

16.673 

3531 

PRWIO 

5 

9.293 

2830 

PRWIO 

4 

15.654 

(obs=24) 

PRWll 

6 

10.628 

(obs=53) 

PRWll 

N/A 

PRW30 

1 

6.299 

PRW30 

3 

14.820 

PRW41 

3 

7.337 

PRW41 

1 

13.009 

PRW42 

2 

6.616 

PRW42 

2 

13.618 

Industry 

ALM 

1 

4.580 

Horizon 

ALM 

1 

5.617 

3550 

PRWIO 

5 

8.101 

1 

PRWIO 

5 

8.496 

(obs=57) 

PRWll 

6 

9.318 

(obs=85) 

PRWll 

5 

8.496 

PRW30 

4 

7.358 

PRW30 

2 

5.682 

PRW41 

2 

4.649 

PRW41 

4 

6.772 

PRW42 

3 

4.908 

PRW42 

3 

6.140 

Industry 

ALM 

2 

4.009 

Horizon 

ALM 

3 

9.165 

3560 

PRWIO 

5 

6.839 

2 

PRWIO 

5 

10.468 

(obs=76) 

PRWll 

6 

6.998 

(obs=78) 

PRWll 

6 

10.680 

PRW30 

1 

3.891 

PRW30 

4 

9.803 

PRW41 

4 

4.887 

PRW41 

2 

8.635 

PRW42 

3 

4.718 

PRW42 

1 

8.544 

Industry 

ALM 

3 

25.699 

Horizon 

ALM 

4 

21.703 

3711/13 

PRWIO 

1 

23.686 

3 

PRWIO 

2 

20.934 

(obs=34) 

PRWll 

4 

29.013 

(obs=67) 

PRWll 

6 

25.864 

PRW30 

2 

23.947 

PRW30 

1 

16.971 

PRW41 

6 

31.447 

PRW41 

3 

21.444 

PRW42 

5 

29.454 

PRW42 

5 

21.867 
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TABLE  5-14 

Sensitivity  Test  1  on  MAbsE  Results 

Mean  Absolte  Error  for  Each  Industry/Horizon  Combination 
Absolute  Error  Less  Than  100 


Stratum 

Industry  2830 
Horizon  1 


Model 


Rank 


Horizon  2 


Horizon  3 


Industry  3531 
Horizon  1 


Horizon  2 


Horizon  3 


ALM 

3 

7.518 

PRWIO 

4 

7.793 

PRWll 

N/A 

PRW30 

5 

8.373 

PRW41 

2 

6.236 

PRW42 

1 

5.848 

ALM 

4 

15.408 

PRWIO 

5 

17.408 

PRWll 

N/A 

PRW30 

3 

15.228 

PRW41 

1 

11.453 

PRW42 

2 

11.945 

ALM 

5 

28.966 

PRWIO 

3 

23.017 

PRWll 

N/A 

PRW30 

1 

22.016 

PRW41 

2 

22.803 

PRW42 

4 

24.728 

ALM 

3 

5.866 

PRWIO 

5 

10.604 

PRWll 

5 

10.604 

PRW30 

1 

4.227 

PRW41 

4 

7.451 

PRW42 

2 

5.542 

ALM 

4 

7.504 

PRWIO 

5 

7.943 

PRWll 

6 

8.775 

PRW30 

2 

5.530 

PRW41 

3 

5.862 

PRW42 

1 

5.490 

ALM 

5 

11.516 

PRWIO 

4 

9.331 

PRWll 

6 

12.506 

PRW30 

3 

9.129 

PRW41 

1 

8.697 

PRW42 

2 

8.817 

MAbsE   Std.Dev.  of  MAbsE 


6.601 
9.534 

8.765 
8.194 
8.129 

14.481 
24.261 

15.891 
15.683 
15.984 

28.921 
26.688 

21.861 
24.647 
23.919 

6.572 
7.679 
7.679 
2.842 
7.561 
3.453 

6.738 
4.498 
6.485 
3.914 
6.563 
5.539 

11.255 

10.348 

13.555 

6.811 

8.854 

8.501 
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Table  5-14  continued 
Stratum 


Model 


Rank 


MAbsE   Std.Dev.  of  MAbsE 


Industry  3711/3713 

ALM 

2 

16.975 

29.061 

Horizon  1 

PRWIO 

4 

21.461 

29.282 

PRWll 

4 

21.461 

29.282 

PRW30 

1 

16.897 

20.380 

PRW41 

5 

25.918 

38.580 

PRW42 

3 

21.241 

34.438 

Horizon  2 

ALM 

4 

29.039 

31.873 

PRWIO 

2 

19.448 

25.790 

PRWll 

1 

17.613 

29.048 

PRW30 

3 

27.934 

27.127 

PRW41 

6 

32.501 

46.361 

PRW42 

5 

30.681 

45.782 

Horizon  3 

ALM 

3 

33.990 

34.725 

PRWIO 

2 

30.892 

37.879 

PRWll 

6 

50.483 

52.514 

PRW30 

1 

29.360 

26.978 

PRW41 

4 

37.766 

46.775 

PRW42 

5 

39.178 

48.254 
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TABLE  5-15 

Sensitivity  Test  2  on  MAbsE  Results 
Mean  Absolute  Error  -  Outlyer  Firms  Eliminated 


Industry 

3531 

Model 

Rank 

MAbsE 

Std 

.Dev.  of  MAbsE 

ALM 

4 

8.295 

8.450 

PRWIO 

5 

9.293 

7.611 

PRWll 

6 

10.628 

9.439 

PRW30 

1 

6.299 

5.070 

PRW41 

3 

7.337 

7.468 

PRWA2 

2 

6.616 

6.122 

Industry 

3550 

Model 

Rank 

MAbsE 

Std 

.Dev.  of  MAbsE 

ALM 

1 

4.652 

7.863 

PRWIO 

4 

5.923 

7.961 

PRWll 

6 

6.563 

9.275 

PRW30 

6 

7.357 

13.131 

PRW41 

2 

4.786 

7.600 

PRW42 

3 

5.064 

7.550 

Model 


Industry  2830 
Rank         MAbsE    Std. Dev.  of  MAbsE 


ALM 

5 

16.740 

20.927 

PRWIO 

1 

11.317 

14.042 

PRWll 

N/A 

N/A 

PRW30 

4 

14.758 

17.109 

PRW41 

2 

13.394 

18.912 

PRW42 

3 

14.055 

18.995 

*  One  firm  eliminated. 
**  Two  firms  eliminated. 
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Annual  Sample  #2  Results 

Sample  #1  demonstrates  the  viability  of  PRWIO,  PRWll,  and  PRW30 
with  all  forecasts  having  a  base  period  ending  with  1975.   Now  a  new 
sample,  Sample  #2,  is  used  to  generate  forecasts  with  three  different 
bases — 1975,  1976,  and  1977.   The  expanded  testing  should  provide 
additional  evidence  concerning  the  contribution  of  the  causal  modeling 
approach.   For  this  sample,  seven  stratifications  of  each  of  three 
industries  are  used  to  test  five  hypotheses.   In  addition,  a  troika  of 
error  measures  is  utilized.   The  discussion  of  the  results  based  on 
this  sample  proceeds  industry  by  industry.   As  mentioned  in  Chapter 
Four,  for  each  industry  and  for  each  error  measure,  the  following  seven 
strata  are  used  to  test  the  hypothesis:  industry;  bases  75,  76,  77;  and 
horizons  1,  2,  and  3.   The  nonparametric  Wilcoxon  matched  pairs 
significance  test  is  a  procedure  that  is  not  sensitive  to  a  few  large 
errors.  This  will  be  helpful  when  the  error  measures  of  two  models  are 
close  but  significantly  different  and  when  two  error  measures  for  two 
other  models  of  the  same  stratum  are  farther  apart  and  not 
significantly  different. 
Industry  3531  Results 

Results  based  on  mean  square  error.   The  first  industry  of  this 
sample  to  be  analyzed  is  contraction  machinery  and  equipment  (3531). 
In  none  of  the  seven  strata  of  Table  5-25  is  ALM  the  model  with  lowest 
MSE.   Table  5-16  indicates  that  PRW30  is  significantly  more  accurate 
than  ALM  for  the  industry,  base  76,  base  77,  horizon  1,  and  horizon  2. 
ALM  is  second  in  accuracy  of  the  industry  and  base  75  and  in  both  these 
cases,  is  significantly  more  accurate  than  PRWll.   No  comparisons 
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TABLE  5-16 

Mean  Square  Error 

Wilcoxon  Level  of  Significance  (p-value) 

Construction  Machinery  and  Equipment 

Industry  3531 


PRWIO 


PRWll 


PRW30 


Industry 

2 
4 
3 

1 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  1 

2 
3 
3 

1 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  2 

2 
4 
3 
1 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  3 

2 
4 
3 

1 

ALM 
PRWIO 
PRWll 
PRW30 

Base  75 

2 
4 
3 

1 

ALM 
PRWIO 
PRWll 
PRW30 

Base  76 

4 
1 
2 
3 

ALM 
PRWIO 
PRWll 
PRW30 

Base  77 

3 

1 
1 
2 

ALM 
PRWIO 
PRWll 
PRW30 

.3057 


.2587 


.4621 


.7283 


.2732 


.6049 


.3450 


.1237 
.7177 


.2587 
1.0000 


.3119 
.7655 


.9307 
.6644 


,1254 
.7372 


.7655^ 
.7536 


.3450 
1.0000 


.0066 
.0722 


.0254 
.1521 


.0681 
.2434 


.7283 
.8619 


.7963 
.1885 


.0070^ 
.0036 


.0811^ 
.0688 


*  Relative  accuracy  is  the  opposite  of  expected. 
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involving  PRWIO  show  a  significant  difference.   No  model  is 

significantly  different  from  another  at  horizon  3.   The  industry  level 

and  horizon  results  are  dominated  by  the  large  MSE's  observed  for  PRWIO 

and  PRWll  in  base  75.   Of  the  35  hypotheses  tested,  only  3  involving 

ALM  result  in  rejection  of  the  null  in  its  favor  at  a  significant 

level:   A2  at  the  industry  level,  A3  at  horizon  3,  and  A2  in  base  75. 

Seven  other  comparisons  are  significantly  different,  but  only  one  is 

contrary  to  the  position  espoused  here — PRW30  outperforms  PRWIO  at  the 

industry  level. 

Results  based  on  absolute  error.   In  terms  of  ranking  the 
performance  of  the  four  models  within  the  seven  stratifications,  the 
situation  is  exactly  the  same  as  the  MSE  results.   The  figures  in  Table 
5-26  show  that  PRW30  is  the  model  with  smallest  MAbsE  five  of  seven 
times  and  PRWIO  ranks  best  the  other  two  times.   The  industry  level 
results  again  are  dominated  by  base  75  findings.   While  PRWIO  and  PRWll 
have  larger  MAbsE  at  most  strata  than  does  ALM,  for  both  base  76  and 
base  77  this  is  not  the  case. 

Although  the  Wilcoxon  significance  test  has  not  been  performed  on 
the  MAbsE  statistics,  it  is  clear  that  the  results  would  be  similar  to 
the  MSE  results.   Because  the  errors  are  not  squared  here  and  because 
of  the  matched  pairs  nature  of  the  test,  there  should  be  even  fewer 
cases  of  significant  difference  in  the  MAbsE  tests. 

Results  based  on  absolute  percent  error.   The  MAbs%E  statistics 
for  the  seven  strata  of  industry  3531  are  presented  in  Table  5-27.   ALM 
is  clearly  the  most  accurate  model  with  PRW30  second.   The  relationship 
between  PRWIO  and  PRWll  is  always  as  hypothesized  with  PRWIO  more 
accurate.   Furthermore  as  expected,  the  size  of  the  error  gets  larger 


TABLE  5-17 

Mean  Absolute  Percent  Error 

Wilcoxon  Level  of  Significance  (p-value) 

Construction  Machinery  and  Equipment 

Industry  3531 
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PRWIO 


PRWll 


PRW30 


Industry 

Rank 
1 
3 
4 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  1 

1 
3 
3 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  2 

1 
3 
4 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  3 

1 
3 
4 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Base  75 

1 
3 
4 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Base  76 

1 
3 

4 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Base  77 

1 
3 
3 
2 

ALM 
PRWIO 
PRWll 
PRW30 

.0474 


,1214 


.2560 


.6644 


.0351 


.8629 


.4377 


.0150^ 
.7686 


.1214 
1.0000 


.1263^ 
.6719 


.3041^ 
.7943 


.0093^ 
.6860 


.8383^ 
.8505 


.4377 
1.0000 


.0015 
.0508 


.0139 
.0777 


.0638 
.1775 


.7943 
.6031 


.7437 
.0834 


.0031 
.0018 


.0413 
.0413 


Relative  accuracy  is  the  opposite  of  expected. 
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as  the  horizon  gets  longer.  The  relative  difference  between  the  means 

shown  in  this  table  seems  to  vary  between  strata  with  the  raw 

difference  in  base  75  very  small  among  PRW  models.   The  results  in 

Table  5-27  indicate  the  dominance  of  ALM  across  all  strata.   However, 

in  some  of  these  cases  the  differences  between  models  is  not 

significant.   Table  5-17  shows  that  null  hypothesis  Al,  comparing  PRWIO 

and  ALM,  is  rejected  with  ALM  significantly  more  accurate  three  out  of 

the  seven  times.   These  strata  are  overall,  horizon  1,  and  base  75. 

Null  hypothesis  A2  also  is  rejected  significantly  in  favor  of  ALM  in 

these  cases  as  well  as  in  horizon  2.   Also  ALM  significantly 

outperforms  PRW30  overall,  in  horizon  1  and  2,  and  in  bases  76  and  77. 

The  relationship  between  PRWIO  and  PRWll  is  always  in  the 

direction  hypothesized  in  the  alternative  with  PRWIO  more  accurate,  but 

not  significantly  more.   Because  PRW30  is  the  second  most  accurate 

model  for  all  strata,  the  comparison  of  PRWIO  and  PRW30  is  contrary  to 

alternative  hypothesis  A5  for  each.   The  result  is  significant  overall, 

at  horizon  1,  and  in  all  bases.   The  MAbs%E  results,  therefore,  are 

very  damaging  to  both  the  DLWM  and  the  DL  without  macros  approaches. 

However,  there  is  considerable  divergence  between  these  results  and 

those  based  on  MSE.   For  instance,  while  the  MAbs%E  findings  for  A3 

reject  the  null  hypothesis  in  favor  of  ALM  five  of  the  seven  times,  the 

MSE  statistics  show  the  opposite;  i.e.,  the  Wilcoxon  test  indicates  a 

significant  difference  in  favor  of  PRW30  rejecting  hypothesis  A3  in 

five  of  the  seven  strata.   Overall  conclusions  as  to  the  value  of  the 

DLWM  approach  in  this  industry  await  the  results  of  the  quarterly 

research  and  more  complete  analysis  of  all  the  results  for  the 

industry. 
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Industry  Group  3550/3560  Results 

Results  based  on  mean  square  error.  As  the  MSE  data  for  the 
special  industry  machinery  and  general  industrial  machinery  and 
equipment  (3550/3560)  group  show  in  Table  5-28,  ALM  is  the  most 
accurate  of  the  four  models  for  all  seven  stratifications.  As  has  been 
the  case  previously,  the  results  are  generally  dominated  by  large  1975 
errors.  This  fact  can  be  seen  by  examining  the  significance  measures 
in  Table  5-18.   The  dominance  is  especially  true  for  hypotheses 
involving  ALM  and  the  DLWM  models.   For  hypothesis  Al,  which  compares 
PRWIO  and  ALM,  the  only  significant  rejections  are  in  favor  of  ALM  at 
base  75  and,  as  a  result,  overall  for  the  industry  group.   For  A2 
(PRWll  versus  ALM)  there  are  the  same  two  significant  rejections  plus 
one  at  horizon  3  in  favor  of  ALM.   It  must  be  remembered,  however,  that 
all  horizon  3  predictions  are  made  with  1975  as  the  base  year.   Thus, 
no  1976-  or  1977-based  predictions  result  in  rejections  of  hypothesis 
Al  or  A2  in  favor  of  ALM. 

As  far  as  hypothesis  A4  (PRWIO  versus  PRWll)  is  concerned,  the 
MSE's  listed  in  Table  5-28  indicate  support.   In  the  five  strata  where 
PRWIO  is  more  accurate,  the  Wilcoxon  test  in  Table  5-18  indicates  that 
none  of  this  superiority  is  significant. 

Many  of  the  Wilcoxon  tests  involving  PRW30  are  significant.   The 
data  indicate  that  PRW30  is  the  model  with  the  largest  MSE  for  six  of 
the  seven  strata.   Only  for  base  76  is  PRW30  more  accurate  than  PRWIO 
or  PRWll.   Hypothesis  A3  (PRW30  versus  ALM)  is  rejected  at  significant 
levels  five  times  (ALM  more  accurate  than  PRW30)  and  the  alternative  is 
not  generally  supported  in  the  other  two  strata.   For  the  six  times 
PRWIO  is  more  accurate  than  PRW30,  the  difference  is  significant  twice 


TABLE  5-18 

Mean  Square  Error 

Wilcoxon  Level  of  Significance  (p-value) 

Special  Industry  and  General  Industrial  Machinery  and  Equipment 

Industries  3550  and  3560 
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PRWIO 


PRWU 


PRW30 


Industry 

Rank 
1 
2 
3 
4 

ALM 
PRWIO 
PRWU 
PRW30 

Horizon  1 

1 
2 
2 
3 

ALM 
PRWIO 
PRWU 
PRW30 

Horizon  2 

1 
2 
3 
4 

ALM 
PRWIO 
PRWU 
PRW30 

Horizon  3 

1 
2 
3 
4 

ALM 
PRWIO 
PRWU 
PRW30 

Base  75 

1 
2 
3 
4 

ALM 
PRWIO 
PRWU 
PRW30 

Base  76 

1 
3 
4 
2 

ALM 
PRWIO 
PRWU 
PRW30 

Base  77 

1 
2 
2 
3 

ALM 
PRWIO 
PRWU 
PRW30 

.0553 


.1622 


.5886 


.1833 


.0546 


.5633 


.6178 


.0519^ 
.7987 


.1622 
1.0000 


.5144^ 
.7793 


.1492* 
.5340 


.0484^ 
.7227 


.5386 
.9999 


.6178 
1.0000 


.0035^ 
.1371 


.0293^ 
.2157 


.1112^ 
.3080 


.3874^ 
.8023 


.5071^ 
.2028 


.0040 
.0086 


.0775^ 
.0489 


*  Relative  accuracy  is  the  opposite  of  expected. 
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(base  77  and  overall).   The  one  time  that  PRW30  is  more  accurate  (base 
76),  the  result  also  is  significant.   Thus,  the  hypothesis  A5  results 
are  mixed. 

Results  based  on  absolute  error.   The  model  comparison  statistics 
of  Table  5-29  are  similar  in  many  ways  to  those  of  Table  5-28.   These 
MAbsE  figures  indicate  the  same  relative  accuracy  of  the  models  as  the 
MSE  results  in  all  strata  except  base  76.   With  these  similarities  and 
the  fact  no  Wilcoxon  significance  of  difference  test  has  been  conducted 
on  these  data,  there  is  little  that  Table  5-29  can  add  to  the  analysis 
of  the  results  of  annual  sample  one.   The  exception  is  base  76,  where 
the  MAbsE  results  show  the  most  accurate  model  is  now  PRW30,  the  MSE 
data  of  Table  5-29  show  ALM  to  be  the  most  accurate  of  the  four  models. 
The  relative  position  of  PRWIO  and  PRWU  does  not  change. 

Results  based  on  absolute  percent  error.   Industry  group  3550/3560 
shows  considerable  variability  among  MAbs%E  results  as  demonstrated  in 
Table  5-30.   ALM  is  the  most  accurate  model  in  four  strata  and  the 
least  accurate  in  one.   PRW30  is  the  most  accurate  three  times  and 
never  is  least  accurate.   Although  ALM  is  more  accurate  than  PRWIO  six 
times,  four  of  which  are  significant,  it  is  less  accurate  in  the  base 
77  stratification  of  the  data  for  this  industry  group. 

Because  of  the  superiority  of  ALM  over  PRWIO,  hypothesis  Al  is 
rejected  in  four  of  the  strata.   Table  5-30  indicates  that  these  strata 
are  overall  industry,  horizon  1,  horizon  3,  and  base  75.   These  are  the 
strongest  findings  thus  far  in  favor  of  ALM.   Here,  too,  the  results 
may  be  dominated  by  the  base  75  results.   The  finding  with  regard  to 
hypothesis  A2  is  the  same  as  with  Al .   Table  5-19  lists  significance  in 
the  same  strata. 


TABLE  5-19 

Mean  Absolute  percent  Error 

Wilcoxon  Level  of  Significance  (p-value) 

Special  Industry  and  Industrial  Machinery  and  Equipment 

Industries  3550  and  3560 
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PRWIO 


PRWll 


PRW30 


Industry 

Rank 
1 
4 
3 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  1 

2 
3 
3 

1 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  2 

1 
4 
2 
3 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  3 

1 
2 
4 
3 

ALM 
PRWIO 
PRWll 
PRW30 

Base  75 

1 
4 
3 
2 

ALM 
PRWIO 
PRWll 
PRW30 

Base  76 

2 
4 
3 

1 

ALM 
PRWIO 
PRWll 
PRW30 

Base  77 

3 
2 

2 
1 

ALM 
PRWIO 
PRWll 
PRW30 

.0087 


,0591 


.4239 


.0617 


.0108 


.3440 


.5340 


.0044 
.7932 


.0591 
1.0000 


.3440 
.7793 


.0387^ 
.5340 


.0030 
.6822 


.4456 
.9999 


.5340 
1.0000 


.0004 
.0731 


.0119 
.1787 


.0614 
.2298 


.1833^ 
.8023 


.2433 
.3233 


.0025 
.0123 


.0489 
.0775 


Relative  accuracy  is  the  opposite  of  expected. 
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The  naute  of  the  difference  between  the  forecast  accuracy  of  PRW30 
and  ALM  is  difficult  to  summarize.   In  two  strata,  the  Wilcoxon  tests 
show  no  significant  difference;  however,  ALM  is  significantly  more 
accurate  in  two — overall  and  horizon  2 — while  PRW30  is  significantly 
more  accurate  at  horizon  1,  base  76,  and  base  77. 

The  comparison  between  the  two  DLWM  models  shows  an  insignificant 
difference  between  them  based  on  MAbs%E.   However,  in  four  cases  PRWU 
is  more  accurate  than  PRWIO.   These  results  would  tend  to  give  some 
evidence  against  the  alternative  hypothesis  A4. 

The  final  hypothesis  tests  the  difference  between  PRWIO  and  PRW30. 
The  results  for  hypothesis  A5  are  mixed.  The  diffference  in  prediction 
in  four  strata  are  not  significant  with  PRWIO  slightly  more  accurate  at 
horizon  3.  All  three  strata  in  which  significant  differences  are  found 
lead  to  rejection  of  hypothesis  A5  in  favor  of  PRW30. 
Industry  Group  3711/3713  Results 

Results  based  on  mean  square  error.   For  the  motor  vehicles,  car, 
truck  and  bus  bodies  (3711/3713)  group,  both  PRWIO  and  PRWll  are  more 
accurate  than  ALM  in  all  cases  except  base  76  and  base  77.   This 
indicates  the  dominance  of  the  base  75  data  on  the  horizon  results  and 
overall.   However,  the  most  striking  feature  of  the  MSE  statistics 
presented  in  Table  5-31  is  the  poor  performance  of  PRW30.   This  model 
is  the  least  accurate  in  all  seven  stratifications  of  the  industry 
group  data.   This  fact,  along  with  the  figures  shown  in  Table  5-20, 
leads  to  the  general  rejection  of  alternative  hypothesis  A3  (PRW30 
versus  ALM)  and  the  acceptance  of  alternative  hypothesis  A5  (PRWIO 
versus  PRW30). 

The  Wilcoxon  data  show  that  the  MSE  of  both  ALM  and  PRWIO  are 


TABLE  5-20 

Mean  Square  Error 

Wilcoxon  Level  of  Significance  (p-value) 

Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 

Industries  3711  and  3713 
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PRWIO 


PRWll 


PRW30 


Industry 

Rank 
3 

1 
2 
4 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  1 

2 

1 
1 
3 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  2 

3 
1 
2 
4 

ALM 
PRWIO 
PRWll 
PRW30 

Horizon  3 

3 
1 
2 
4 

ALM 
PRWIO 
PRWll 
PRW30 

Base  75 

3 

1 
2 
4 

ALM 
PRWIO 
PRWll 
PRW30 

Base  76 

1 
2 
3 
4 

ALM 
PRWIO 
PRWll 
PRW30 

Base  77 

1 
2 
2 
3 

ALM 
PRWIO 
PRWll 
PRW30 

.3277 


.2407 


.9801 


.5774 


.5954 


.6894 


.5282 


.2759^ 
.8781 


.2407 
1.0000 


.9402^ 
.9601 


.3955, 
.6822 


.4533, 
.8642 


.6531, 
.9303 


.5282 
1.0000 


.0092, 
.0421 


.0137, 
.0830 


.2247, 
.1522 


.9702, 
.7942 


.8690, 
.8786 


.0084, 
.0215 


.0238, 
.0917 


Relative  accuracy  is  the  opposite  of  expected. 
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significantly  different  than  that  of  PRW30  in  many  cases.   For 
hypothesis  A3,  ALM  is  significantly  more  accurate  at  horizon  1,  bases 
76  and  77,  and  overall.   For  hypothesis  A5,  PRWIO  is  significantly  more 
accurate  at  these  points  and,  in  addition,  at  horizon  2.   The  remainder 
of  the  MSE  statistics  for  the  3711/3713  group  are  insignificantly 
different  from  one  another. 

Results  based  on  absolute  error.   As  with  most  of  the  results 
discussed  thus  far,  the  data  in  Table  5-32  show  that  as  the  forecast 
horizon  gets  longer,  the  magnitude  of  the  error  increases.   The 
relative  performance  of  the  four  models  based  on  MAbsE  is  essentially 
the  same  as  based  on  MSE. 

Results  based  on  absolute  percent  error.   Up  to  this  point,  the 
performance  of  PRW30  for  the  3711/3713  industry  group  has  been  dismal. 
Now  in  Table  5-33  the  MAbs%E  data  indicate  that  this  model  is  the 
second  most  accurate  in  many  of  the  strata  and  most  accurate  at  horizon 
3.   Another  result  presented  in  this  table — the  relative  performance  of 
the  ALM  model — is  contrary  to  the  findings  based  on  the  other  two  error 
metrics.   Here  ALM  is  most  accurate  overall,  at  bases  76  and  77,  and  at 
horizon  1  and  2.   However,  the  Wilcoxon  data  of  Table  5-21  show  that 
ALM  is  never  significantly  more  accurate  than  PRWIO  or  PRWll.   As  with 
the  data  of  Table  5-20,  the  only  significant  differences  involve 
comparisons  with  PRW30. 
Summary  of  Annual  Sample  #2  Results 

In  order  to  synthesize  the  results  of  the  second  annual  sample, 
the  findings  are  summarized  in  a  series  of  three  tables.   The  first, 
Table  5-22,  lists  the  rankings  from  most  accurate  (1)  to  least  accurate 
(4)  of  the  four  models  of  all  strata  and  for  each  error  measure.   Thus, 


TABLE  5-21 

Mean  Absolute  Percent  Error 

Wilcoxon  Level  of  Significance  (p-value) 

Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 

Industries  3711  and  3713 
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PRWIO 


PRWU 


PRW30 


Industry 


Rank 

1  ALM 

3  PRWIO 

4  PRWll 

2  PRW30 


.2779 


.1853^ 
.6623 


.0010 
.0157 


Horizon  1 


1  ALM 

3  PRWIO 

3  PRWl 1 

2  PRW30 


.2312 


.2312 
1.0000 


.0026 
.0561 


Horizon  2 


1  ALM 

4  PRWIO 

2  PRWl 1 

3  PRW30 


.9402 


.8808 
.8415 


.0901 
.0736 


Horizon  3 


2  ALM 

3  PRWIO 

4  PRWl 1 
1  PRW30 


.4814 


,2016^ 
.3955 


.7375 
.7942 


Base  75 


3  ALM 

1  PRWIO 

4  PRWl 1 

2  PRW30 


.3770 


.1760^ 
.5499 


.6039^ 
.7554 


Base  76 


1  ALM 

4  PRWIO 

3  PRWl 1 

2  PRW30 


.6531 


.6531 
.9104 


.0065 
.0124 


Base  77 


1  ALM 

3  PRWIO 

3  PRWl 1 

2  PRW30 


.9109 


.9109 
1.0000 


.0147 
.0443 


*  Relative  accuracy  is  the  opposite  of  expected. 
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for  each  industry  there  are  21  rankings  presented  (i.e.,  for  seven 
strata  for  three  error  measures).   The  second  table.  Table  5-23, 
contains  a  summary  of  the  hypothesis  testing  based  on  MSE.   For  each 
strata  of  each  industry,  one  of  six  possible  entries  is  made  in  the 
table.  The  notations  presented  there  are: 

(1)  The  letter  R  followed  by  the  significance  level  (if  less  than 
0.1500)  to  indicate  the  rejection  of  the  null  hypothesis  with 
the  literature  supported  model  more  accurate 

(2)  A  dash  indicating  a  nonsignificant  difference  between  a  pair 
of  model  predictions  with  the  more  accurate  being  contrary  to 
the  stated  objective  of  this  project 

(3)  The  letter  0  when  the  relative  accuracy  of  PRWIO  and  PRWll  is 
opposite  of  that  expected 

(4)  N/A  when  the  two  models  are  the  same  in  a  particular  instance 

(5)  The  letter  A  followed  by  the  significance  level  if  less  than 
0.1500  to  indicate  a  significant  difference  in  favor  of  the 
alternative  hypothesis. 

The  third  summarizing  table.  Table  5-24,  is  organized  in  the  same 
manner  as  the  previous  one  except  the  hypothesis  data  are  based  on 
MAbs%E  instead  of  MSE. 

Summary  of   industry  3531.   The  rankings  in  Table  5-22  show  that 
for  industry  3531  there  is  considerable  variation  across  error 
measures.   PRW30  ranks  first  most  of  the  time  when  using  either  MSE  or 
MAbsE,  while  ALM  ranks  first  in  all  seven  strata  when  using  MAbs%E. 
Even  the  relative  ranking  of  PRWIO  and  PRWll  seems  to  follow  this 
pattern:   PRWIO  is  ranked  most  often  fourth  for  the  first  two  error 
measures  and  third  each  time  using  MAbs%E  while  PRWll  seems  to  rank 
third  and  fourth,  respectively. 

The  primary  significance  of  the  data  in  Table  5-22  is  the 
information  it  supplies  with  regard  to  hypothesis  Al ,  comparing  PRWIO 
and  ALM.   Of  the  14  strata  in  which  Wilcoxons  are  performed,  only  5 
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TABLE  5-23 


Hypothesis  Summary 
Mean  Square  Error 

Stratxim 

10 

Al 

vs  ALM 

A2    1 
11  vs  ALM 

Hypothesis 

A3 

30  vs  ALM 

A4 
10  vs  11 

A5 
10  vs  30 

3531 

Industry 

- 

R  (.1237) 

A  (.0066) 

0 

R 

(.0722) 

Horizon  1 
2 
3 

- 

- 

A  (.0254) 

A  (.06681) 

A 

N/A 
0 
0 

R 

(.1521) 

Base  75 
76 
11 

A 

A 

R  (.1254) 
A 
A 

A 
A  (.0070) 
A  (.08119 

0 

A 
N/A 

A 
A 

(.0036) 
(.0688) 

3550/3560 

Intiustry 

R 

(.0553) 

R  (.0519) 

R  (.0035) 

A 

A 

(.1371) 

Horizon  1 
2 
3 

- 

R  (.1492) 

R  (.0293) 
R  (.1112) 

N/A 
A 
A 

A 
A 
A 

Base  75 
76 
11 

R 

(.0546) 

R  (.0484) 

R  (.0400) 
R  (.0775) 

A 

A 
N/A 

R 
A 

A 
(.0086) 
(.0489) 

3711/3713 

Industry 

A 

A 

R  (.0092) 

A 

A 

(.0421) 

Horizon  1 
2 
3 

A 
A 
A 

A 
A 
A 

R  (.0137) 

N/A 
A 
A 

A 
A 

(.0830) 
(.1522) 

A 

Base  75 
76 
77 

A 

A 

R  (.0084) 
R  (.0238) 

A 

A 

N/A 

A 
A 

A 
(.0215) 
(.0917) 

Notation  is  defined  on  the  following  page. 
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Legend  for  Tables  5-23  and  5-24 


Entries  in  table  from  least  favorable  to  most  favorable; 


Notation  Meaning 

R(.XXXX)  Null  hypothesis  is  £ejected  at  significance  level  less 
than  fifteen  percent  and  the  result  is  the  opposite  of 
what  was  expected. 

-        Wilcoxon  test  is  insignificant,  but  direction  is  non 
supportive  of  the  DL  model. 

0         In  the  case  of  hypothesis  A4  (comparing  PRWIO  and  PRWU), 
the  result  is  the  ^opposite  of  what  was  expected. 

N/A        At  horizon  1  models  PRWIO  and  PRWll  are  the  same. 

A  While  the  Wilcoxon  is  non  significant,  the  DLWM  model  must 
be  accepted  due  to  the  relative  accuracy  of  the  two  models 
being  compared. 

A(.XXXX)     Not  only  is  the  result  in  support  of  the  DLWM  model, 
but  there  is  an  indication  of  a  significant  (<  .1500) 
level  of  difference.  The  null  is  rejected  favorably. 
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TABLE  5-24 

Hypothesis  Summary 
Mean  Absolute  percent  Error 


Stratum 

Al 
10  vs  ALM 

A2 
11  vs  ALM 

Hypothesis 

A3 

30  vs  ALM 

A4 
10  vs  11 

A5 
10  vs  30 

3531 

Industry 

R  (.0474) 

R  (.0150) 

R  (.0015) 

A 

R  (.0508) 

Horizon  1 
2 
3 

R  (.1214) 

R  (.0150) 
R  (.1263) 

R  (.0139) 
R  (.0638) 

N/A 
A 
A 

R  (.0777) 

Base  75 
76 
77 

R  (.0351) 

R  (.0093) 

R  (.0031) 
R  (.0413) 

A 

A 
N/A 

R  (.0834) 
R  (.0018) 
R  (.0413) 

3550/3560 

Industry 

R  (.0087) 

R  (.0044) 

R  (.0004) 

0 

R  (.0731) 

Horizon  1 
2 
3 

R  (.0591) 
R(.0617) 

R  (.0591) 
R  (.0387) 

A  (.0119) 
R  (.0614) 

N/A 
0 
A 

A 

Base  75 
76 
77 

R  (.0108) 
A 

R  (.0030) 
A 

A  (.0025) 
A  (.0489) 

0 
0 

N/A 

R  (.0133) 
R  (.0775) 

3711/3713 

Industry 

- 

- 

R  (.0010) 

A 

R  (.0157) 

Horizon  1 
2 
3 

- 

- 

R  (.0026) 

R  (.0901) 

A 

N/A 
0 
A 

R  (.0561) 
R  (.0736) 

Base  75 
76 
77 

A 

- 

A 
R  (.0065) 
R  (.0147) 

A 
0 

N/A 

A 
R  (.0124) 
R  (.0443) 

Notation  is  defined  on  the  previous  page. 
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show  a  significant  difference  in  favor  of  ALM.   The  table  also  shows, 
while  not  significantly,  that  PRWIO  outperforms  ALM  four  times — base  76 
and  77  for  MSE  and  base  76  and  77  for  MAbsE. 

When  comparing  the  rankings  across  error  measures,  the  difference* 
between  the  MAbs%E  statistics  and  the  other  two  measures  is  obvious. 
In  addition,  the  rankings  of  the  seven  strata  by  MSE  and  by  MAbsE  are 
exactly  the  same  across  error  measures.   Within  the  set  of  seven 
rankings  for  both  error  measures,  however,  there  is  some  variance; 
attributable  to  the  results  for  bases  76  and  77  which  favor  the  DLWM 
models  while  the  other  five  strata  favor  ALM.   There  is  no  variance 
among  the  rankings  of  the  seven  strata  when  using  MAbs%E. 

Industry  3531 's  hypothesis  testing  summary  is  contained  in  frame  1 
of  both  Table  5-23  and  Table  5-24.   The  MSE  results  of  Table  5-23  show 
"favorable"  results  in  the  sense  that  whenever  ALM  outperforms  the  PRW 
models,  the  difference  is  not  significant.   The  figures  also  show  it  is 
difficult  to  determine  the  relative  performance  of  PRWIO  and  PRW30. 
The  most  powerful  statement  which  can  be  made  on  the  basis  of  the  data 
presented  in  Table  5-23  is  the  complete  dominance  of  PRW30  over  ALM  as 
given  by  the  hypothesis  A3  results.   This  information  indicates  that 
alternative  A3  can  be  accepted  in  all  seven  strata  with  the  difference 
between  PRW30  and  ALM  being  significant  five  of  the  seven  times. 

The  encouragement  offered  by  Table  5-23  is  tempered  by  an  analysis 
of  the  data  in  Table  5-24.   The  number  of  times  a  hypothesis  is 
rejected  in  favor  of  Alil  comprises  a  significant  portion  of  the  table. 
Only  alternative  hypothesis  A4  is  supported.   For  the  21  comparisons 
involving  ALM,  all  MAbs%E  measures  show  it  to  be  more  accurate  with  12 
of  these  at  a  significant  level. 
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Summary  of  industry  group  3550/3560.   The  rankings  of  Table  5-22 
indicate  the  superiority  of  ALM  across  error  statistics  except  for  base 
76,  base  77,  and  horizon  1,  when  the  error  measure  is  MAbs%E.   PRW30 
also  has  its  best  performance  in  the  MAbs%E  data.   Taken  together,  the 
hypotheses  summaries  of  Table  5-23  and  Table  5-36  lend  strong  support 
for  the  rejection  of  hypotheses  Al  and  A2  in  reverse  direction  to  that 
expected.   However,  there  are  exceptions  which  should  be  noted.   First, 
most  of  the  MSE  superiority  of  ALM  in  Table  5-23  is  not  at  a 
significant  level.   Second,  the  superiority  of  ALM  based  on  MAbs%E 
seems  to  be  related  to  its  performance  in  the  base  75  results.   In 
fact,  the  base  77  results  show  that  not  only  is  ALM  not  significantly 
better  than  the  other  two  models,  but  it  is  less  accurate  here.   The 
two  tables  give  contradictory  results  with  respect  to  hypothesis  A3, 
A4,  and  A5. 

Summary  of  industry  group  3711/3713.  As  Table  5-22  indicates,  the 
rankings  based  on  MSE  and  the  rankings  based  on  MAbsE  are  exactly  the 
same,  except  for  base  75.   the  dominance  of  PRWIO  over  ALM,  although 
not  at  a  significant  level,  is  built  upon  the  performance  of  the  base 
75  result  for  these  two  error  statistics.   The  MAbs%E  figures  indicate 
the  dominance  of  ALM  except  when  based  on  base  75  data. 

Tables  5-23  and  5-24  show  that  no  comparisons  between  DLWM  models 
and  ALM  are  significantly  different.  Most  of  Table  5-23  shows  that 
both  PRWIO  and  PRWll  are  insignificantly  more  accurate  than  ALM 
(hypotheses  Al  and  A2)  while  Table  5-24  shows  ALM  insignificantly  more 
accurate  in  all  cases  except  one. 

The  two  tables  are  inconsistent  again  with  regard  to  hypothesis 
A5.   The  MSE  data  support  acceptance  of  the  DLWM  models  at  a 
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significant  level,  while  the  MAbs%E  data  support  rejection  at  a 
significant  level.   The  tables  generally  agree  that  the  null  hypothesis 
A3  should  be  rejected  with  PRW30  significantly  less  accurate  than  ALM  9 
of  the  14  times  hypothesis  A3  is  tested  in  this  industry. 

In  summary  the  entire  sample  #2  results  are  mixed,  especially  with 
regard  to  hypotheses  A4  and  A5.   The  DLWM  models  are  weak  in  industry 
group  3550/3560,  relatively  strong  in  industry  group  3711/3713  ,  and 
the  error  measures  give  different  answers  in  industry  3531.   PRW30, 
especially  when  compared  to  ALM,  is  consistently  rejected  (except  in 
industry  3531)  based  on  MSE  only. 


TABLE  5-25 

Mean  Square  Error 

Construction  Machinery  and  Equipment 

Industry  3531 
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Model 


Rank. 


MSE 


PRWIO 
PRWll 
PRW30 
ALM 

4 
3 
1 
2 

18529.85 

14200.78 

257.72 

875.32 

Horizon  = 

1 

Base  =  75 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

3 
3 

1 
2 

Horizon  = 

2743.11 

2743.11 

186.34 

526.51 

2 

PRWIO 
PRWll 
PRW30 
ALM 

4 
3 
1 
2 

Base  =  76 

36930.59 

28229.05 

289.45 

538.80 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

4 
3 
1 
2 

Horizon  = 

15415.17 

12024.88 

425.46 

1187.71 

3 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
3 

4 

Base  =  77 

119.68 

184.80 

206.63 

1256.62 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

4 
3 

1 
2 

72119.41 

52925.60 

136.40 

1302.96 

PRWIO 
PRWl  1 
PRW30 
ALM 

1 
1 
2 
3 

147.95 

147.95 

264.73 

1128.28 

TABLE  5-26 

Mean  Absolute  Error 

Construction  Machinery  and  Equipment 

Industry  3531 
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Model 


Rank 


MAbsE 


PRWIO 
PRWll 
PRW30 

ALM 

4 
3 

1 
2 

37.7047 
35.4414 
10.3509 
13.8756 

Horizon 

=  1 

Base  =  75 

Model 

Rank 

MAbsE 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

3 
3 

1 
2 

Horizon 

18.2309 

18.2309 

8.5567 

11.3436 

=  2 

PRWIO 
PRWll 
PRW30 
ALM 

4 
3 
1 
2 

Base  =  76 

67.3414 
61.8720 
10.1956 
12.4804 

Model 

Rank 

MAbsE 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

4 
3 

1 
2 

36.9121 
35.1794 
13.3066 
13.9993 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
3 

4 

7.3813 

8.7956 

9.8907 

15.1984 

Horizon  =  3 
Model     Rank   MAbsE 


PRWIO 
PRWll 
PRW30 
ALM 


4 

97.7111 

3 

87.5968 

1 

9.8223 

2 

21.2242 

Base  =  77 
Model     Rank    MAbsE 


PRWIO 
PRWll 
PRW30 
ALM 


1 

9.4414 

1 

9.4414 

2 

11.7372 

3 

15.4157 

TABLE  5-27 

Mean  Absolute  Percent  Error 

Construction  Machinery  and  Equipment 

Industry  3531 
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Model 


Rank 


MAbs%E 


PRWIO 
PRWll 
PRW30 
ALM 

3 

4 
2 

1 

0.4374 
0.4600 
0.3178 
0.1900 

Horizon  = 

1 

Base 

=  75 

Model 

Rank 

MAbs%E 

Model 

Rank 

MAbs%E 

PRWIO 
PRWll 
PRW30 
ALM 

3 
3 

2 
1 

0.4058 
0.4058 
0.2864 
0.1750 

PRWIO 
PRWll 
PRW30 
ALM 

3 
4 
2 

1 

0.5057 
0.5402 
0.2953 
0.2098 

Horizon  = 

2 

Base 

=  76 

Model 

Rank 

MAbs%E 

Model 

Rank 

MAbs%E 

PRWIO 
PRWll 
PRW30 
ALM 

3 
4 
2 

1 

0.4630 
0.5024 
0.3625 
0.1955 

PRWIO 
PRWll 
PRW30 
ALM 

3 
4 
2 

1 

0.3628 
0.3788 
0.3613 
0.1789 

Horizon  = 

3 

Has 

e  =  77 

Model 

Rank 

MAbs%E 

Model 

Rank 

MAbs%E 

PRWIO 
PRWll 
PRW30 
ALM 

3 

4 
2 

1 

0.4779 
0.5347 
0.3227 
0.2239 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 

1 

0.2816 
0.2816 
0.2981 
0.1628 
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TABLE  5-28 

Mean  Square  Error 

Special  Industry  and  General  Industrial  Machinery  and  Equipment 

Industries  3550  and  3560 


Model 


Rank 


MSE 


PRWIO 
PRWll 
PRW30 
ALM 

2 
3 

4 
1 

70.2227 

97.9893 

206.4710 

32.7784 

Ho 

rizon  = 

1 

Base  =  75 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 

1 

29.9192 
29.9192 
57.3655 
18.1120 

PRWIO 
PRWll 
PRW30 
ALM 

2 
3 
4 
1 

82.3789 
119.0904 
339.5293 

29.4226 

Horizon  = 

2 

Base  =  76 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
3 

4 

1 

78.4869 
112.4118 
377.0114 

50.0389 

PRWIO 
PRWll 
PRW30 
ALM 

3 
4 
2 
1 

59.2495 
84.6287 
45.0773 
36.8040 

Ho 

rizon  = 

3 

Bas 

,e  =  77 

Model 

Rank 

Mean 

Model 

Flank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
3 

4 

1 

210.0315 

317.8554 

370.4847 

47.8011 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 

1 

50.1522 
50.1522 
81.1544 
36.0415 

TABLE  5-29 

Mean  Absolute  Error 

Special  Industry  and  General  Industrial  Machinery  and  Equipment 

Industries  3550  and  3560 
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Model 


Rank 


MAbsE 


PRWIO 
PRWll 
PRW30 
ALM 

2 
3 

4 
1 

5.1796 
5.8687 
5.8748 
3.3769 

Horizon  = 

1 

Bas 

e  =  75 

Model 

Rank. 

MAbsE 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 
1 

3.6857 
3.6857 
3.6963 
2.5836 

PRWIO 
PRWll 
PRW30 
ALM 

2 
3 
4 
1 

5.8636 
6.7378 
7.6848 
3.2302 

Horizon  = 

2 

Bas 

e  =  76 

Model 

Rank 

MAbsE 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
3 
4 
1 

5.7358 
6.8020 
7.6240 
4.4634 

PRWIO 
PRWll 
PRW30 
ALM 

3 

4 
1 
2 

4.4849 
5.1749 
3.3232 
3.3860 

Horizon  = 

3 

Base  =  77 

Model 

Rank 

MAbsE 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
4 
3 

1 

9.4570 

11.8440 

9.9681 

3.8398 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 

1 

4.2266 
4.2266 
4.9841 
3.9006 

TABLE  5-30 

Mean  Absolute  Percent  Error 

Special  Industry  and  General  Industrial  Machinery  and  Equipment 

Industries  3550  and  3560 
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Model 


Rank 


MAbs%E 


PRWIO 
PRWll 
PRW30 
ALM 

4 
3 
2 
1 

1.0675 
1.0152 
0.7786 
0.6336 

Horizon  = 

1 

Base 

.  =  75 

Model 

Rank 

MAbs%E 

Model 

Rank 

MAbs%E 

PRWIO 
PRWll 
PRW30 
ALM 

3 
3 
2 

1 

1.0305 
1.0305 
0.5913 
0.5443 

PRWIO 
PRWll 
PRW30 
ALM 

4 
3 
2 

1 

1.1119 
1.0821 
0.7874 
0.3431 

Horizon  = 

2 

Base  =  76 

Model 

Rank 

MAbs%E 

Model 

Rank 

MAbs%E 

PRWIO 
PRWll 
PRW30 

ALM 

4 
2 
3 

1 

1.1680 
0.9166 
0.9560 
0.7679 

PRWIO 
PRWll 
PRW30 
ALM 

4 
3 

1 
2 

1.0506 
0.9391 
0.7304 
0.7530 

Horizon  = 

3 

Ba£ 

e  =  77 

Model 

Rank 

MAbs%E 

Model 

Rank 

MAbs%E 

PRWIO 
PRWll 
PRW30 
ALM 

2 
4 
3 

1 

0.9753 
1.1842 
1.0685 
0.2873 

PRWIO 
PRWll 
PRW30 

ALM 

2 
2 
1 
3 

0.9411 
0.9411 
0.8659 
1.4402 

TABLE  5-31 

Mean  Square  Error 

Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 

Industries  3711  and  3713 
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Model 


Rank 


MSE 


PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
4 
3 

124966 

171398 

2373275 

269126 

Horizon 

=  1 

Base 

.  =  75 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

1 
1 
3 
2 

59348.3 

59348.3 

660956.7 

122640.1 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
4 
3 

168220.7 
238418.0 
480749.3 
472696.5 

Horizon 

=  2 

Base  =  76 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
1 
4 
3 

168468.4 

190617.6 

5926579.0 

330284.3 

PRWIO 
PRWll 
PRW30 
ALM 

2 
3 
4 
1 

84889.3 

114955.8 

6020702.4 

60773.8 

Horizon 

=  3 

Ba£ 

e  =  77 

Model 

Rank 

MSE 

Model 

Rank 

MSE 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
4 
3 

298713.2 
512010.4 
733221.4 
638750.1 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 

1 

62063.1 

62063.1 

1148267.7 

14530.7 

TABLE  5-32 

Mean  Absolute  Error 

Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 

Industries  3111  and  3713 
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Model 


Rank 


MAbsE 


PRWIO 
PRWll 
PRW30 
ALM 

Horizon  = 

1 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

1 
1 
3 
2 

123.677 
123.677 
348.111 
148.491 

Horizon  = 

2 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
4 
3 

201.014 
227.522 
810.483 
274.488 

Horizon  = 

3 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

3 
1 
4 
2 

287.564 
373.379 
390.075 
382.524 

1 
2 
4 
3 

173.876 
195.643 
503.949 
225.203 

Base 

=  75 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
3 
4 

210.163 
237.433 
310.410 
325.736 

Base 

=  76 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
3 
4 
1 

147.458 
170.680 
824.102 
141.686 

Bas 

e  =  77 

Model 

Rank 

MAbsE 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 

1 

105.976 

105.976 

489.657 

58.775 

TABLE  5-33 

Mean  Absolute  Percent  Error 

Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 

Industries  3711  and  3713 
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Model 

PRWIO 
PRWll 
PRW30 
ALM 


Rank 

3 

4 
2 
1 


MAbs%E 

14.5703 

14.7124 

8.8080 

6.3815 


Horizon 

Model    Rank 

PRWIO  3 

PRWll  3 

PRW30  2 

ALM  1 


MAbs%E 

11.6541 

11.6541 

6.1460 

1.5525 


Base  =  75 
Model     Rank    MAbs%E 


PRWIO 

1 

8.9893 

PRWll 

4 

13.3362 

PRW30 

2 

8.9912 

ALM 

3 

10.1312 

Horizon 

Model    Rank 

PRWIO  4 

PRWl 1  2 

PRW30  3 

ALM  1 

Horizon 

Model    Rank 

PRWIO  3 

PRWll  4 

PRW30  1 

ALM  2 


=  2 


MAbs%E 

14.5184 
7.4172 
8.8310 
6.7469 


=  3 


MAbs%E 

24.5941 
40.4302 
21.2103 
24.0985 


Base  =  76 
Model     Rank     MAbs%E 


PRWIO 
PRWll 
PRW30 
ALM 

4 
3 
2 
1 

Base  =  77 

18.7915 

12.1936 

6.8394 

3.0844 

Model 

Rank 

MAbs%E 

PRWIO 
PRWll 
PRW30 
ALM 

3 
3 
2 
1 

24.6808 

24.6808 

12.3190 

0.5563 
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Quarterly  Results 

Although  PRW  models  do  not  outperform  the  other  methods,  Wilcoxon 

nonparametric  tests  of  difference  between  the  MSB's  of  prediction 

indicate  nonsignificant  difference  of  mean  errors  across  industries  and 

all  prediction  horizons  except  one  quarter  ahead.   In  one  industry 

(3531),  the  PRWll  model  does  generally  better  than  competing  methods. 

In  two  industries  (3550  and  3711/13),  PRW  models  are  consistently  worse 

than  all  other  models  tested.   In  industry  3560,  PRWIO  outperforms  all 

other  models  except  BJ-F  at  horizons  4  and  5,  but  the  PRW  models  are 

outperformed  otherwise.   For  three  industries  (3550,  3560,  and 

3711/13),  a  different  model  each  time  is  most  accurate: 

Industry  Best 

3550  Box- Jenkins:   Brown  and  Rozeff  (BJ-BR) 

3560  Box- Jenkins :   Foster  (BJ-F) 

3711/13  non  Box-Jenkins  Foster  (FOST) 

Industry  3531  Results 

For  the  construction  machinery  and  equipment  industry  (3531)  the 
relative  performance  of  the  six  models  is  presented  in  Tables  5-34, 
5-35,  and  5-47  through  5-49.   Figure  4  also  shows  the  distribution  of 
ABs%E  for  this  industry. 

Results  based  on  mean  square  error.   Table  5-49  presents  the  MSE 
for  each  model  for  the  industry  as  a  whole  and  for  the  predictions  of 
each  forecast  horizon  1  to  5.   The  MSE  results  indicate  that  PRWll  is 
the  overall  best  while  the  Box-Jenkins  model,  Watts-Griffin  (BJ-WG) ,  is 
second  and  consistently  second  or  third  most  accurate  over  the 
individual  horizon  results.   The  non-BJ  model  FOST  is  the  most  accurate 
at  both  horizon  3  and  4. 

The  performance  of  PRWIO  varies  from  best  to  worst,  depending  on 
the  horizon,  with  the  better  relative  accuracy  at  shorter  horizons. 
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Overall  this  model  ranks  fifth  in  accuracy.   The  BJ-BR  model  performs 

the  worst  overall  and  consistently  ranks  poorly  across  horizons. 

Most  of  these  differences  in  forecast  accuracy  are  not 
significant.  The  data  in  Table  5-34  indicate  that  of  the  63  hypotheses 
tests  using  MSE  for  this  industry,  only  17  Wilcoxons  resulted  in 
measures  of  less  than  15%;  11  of  these  involve  PRWIO. 

As  for  hypothesis  Ql ,  which  compares  PRWll  and  FOST,  the  findings 
indicate  superiority  of  PRWll  at  the  industry  level  and  at  horizons  1, 
2,  and  5.   The  first  two  of  these  strata  results  show  significant 
difference.   For  horizon  3,  FOST  is  significantly  more  accurate;  for 
horizon  4,  there  is  no  significant  difference  although  FOST  again  is 
the  better  predictor.   The  hypothesis  Q2  results  are  more  consistent. 
PRWll  is  more  accurate  in  all  cases  except  horizon  4,  and  none  of  the 
six  strata  shows  a  significant  difference  between  PRWll  and  BJ-F.   The 
most  consistent  findings  of  industry  3531  are  for  hypothesis  Q3.   In 
all  strata,  PRWll  is  insignificantly  more  accurate  than  BJ-BR.   No 
rejection  of  hypothesis  Q4  is  indicated  by  Table  5-34. 

These  four  hypotheses  involving  PRWll  indicate  its  superiority 
over  the  time-series  models.   PRWIO  also  dominates  the  other  models, 
but  to  a  much  lesser  extent.   The  MSE  statistics  of  Table  3-47  show 
that  PRWIO  is  more  accurate  than  the  time-series  models  at  horizon  1 
and  2  and  more  accurate  than  the  BJ  models  at  horizon  3.   In  terms  of 
the  hypothesis  (Q5)  involving  these  models  and  horizons,  the  following 
results  obtain:   PRWIO  is  significantly  more  accurate  than  FOST  at 
horizon  1,  nonsignif icantly  better  an  horizon  2,  and  significantly 
worse  at  horizon  3.   The  results  for  both  Q6  and  Q7  at  all  three  of 


TABLE  5-34 

Industry  3531 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Squared  Error 
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Stratum 


Model 


PRWll 


FOST 


BJ-F 


BJ-BR 


BJ-WG 


Rank 
All  horizons5 
1 
3 
4 
6 
2 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.3182 


.0050 
.1045 


.0236 
.2491 


.0200 
.2210 


.0004 
.1027 


Horizon  1 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


1.0000 


.1136 
.1136 


.1942 
.1942 


.2447 
.2447 


.0580 
.0580 


Horizon  2 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.6547 


.3202 
.6671 


.9041 
.7830 


.3909 
.6423 


.1569 
.2807 


Horizon  3 


3  PRWIO 

4  PRWl 1 

1  FOST 

5  BJ-F 

6  BJ-BR 

2  BJ-WG 


.8633 


.1339 
,1382 


.4198 
.4100 


,5705 
.5028 


.3120 
.2732 


Horizon  4 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.3724 


.4499 
.8363 


.4397 
.8498 


.4198 
.9588 


.0864 
.4499 


Horizon  5 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.1619 


.2248 
.8633 


.0750 
.5705 


.0777 
.7437 


.0959 
.7307 
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these  horizons  are  nonsignificant.   For  Q8,  PRWIO  is  significantly  more 

accurate  than  BJ-WG  at  horizon  1  and  2  while  no  significance  is  found 

in  BJ-WG' s  better  MSE  at  horizon  3. 

Comparisons  of  PRWIO  to  the  time-series  models  at  horizon  4  show 
it  to  be  less  accurate  than  each  of  the  four  models.   The  Wilcoxon 
measures  of  Table  5-34  indicate  only  one  significant  case.   That  is  Q8, 
where  BJ-WG  is  significantly  better  than  PRWIO.   At  horizon  5  there  is 
significant  rejection  additionally  of  null  hypotheses  Q6  and  Q7  (BJ-F 
and  BJ-BR  more  accurate  than  PRWIO). 

Results  based  on  absolute  error.   The  relative  accuracy  of  the 
various  models  depends,  to  a  great  extent,  on  the  forecast  horizon  when 
the  measure  of  accuracy  is  MAbsE.   The  results  in  Table  5-48  show  some 
consistency  among  stratification  for  industry  3531  and  can  be  viewed  in 
two  parts — with  horizons  5  and  6  together  and  with  the  other  four 
strata  in  another  group.   Then  the  MAbsE  results  have  BJ-WG  most 
accurate  and  dominating  in  both  subsets.   FOST,  although  worst  or  next 
to  worst  in  most  strata,  is  among  the  best  at  horizons  4  and  5. 

Results  based  on  absolute  percent  error.   The  BJ  models  are 
clearly  superior  when  the  measure  of  accuracy  is  MAbs%E.   BJ-WG  is  the 
most  accurate  of  all  models  tested  for  each  stratification  of  this 
industry  except  horizon  4.   The  statistics  listed  in  Table  5-49 
indicate  that  overall  BJ-F  is  second  most  accurate  and  is  reasonably 
consistent  in  ranking  second  or  third  across  strata.   BJ-BR' s  overall 
ranking  of  third  Is  not  maintained  among  the  other  strata  since  it  is 
fourth  twice  and  fifth  at  horizon  4. 

PRWIO  usually  Is  least  accurate  with  PRWll  next,  except  as 
mentioned  at  horizon  4  in  which  case  PRWll  is  the  most  accurate.   No 
consistency  is  found  across  strata  for  the  relative  accuracy  of  FOST. 
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Many  of  the  differences  in  accuracy  noted  here  are  non- 
significant. The  data  of  Table  5-35  do  show  some  significant 
differences,  but  by  and  large  these  findings  are  isolated  to  three 
areas.  First,  at  the  industry  level,  hypotheses  involving  PRWIO, 
Q5-Q8,  are  rejected  at  significant  levels  with  PRWIO  less  accurate  each 
time.   Second,  horizon  1  comparisons  involving  PRWll  and  PRWIO  are 
significant  except  for  those  involving  BJ-BR.   Thus,  hypotheses  Ql ,  Q2, 
Q4,  Q5,  Q6,  and  Q8  are  rejected  in  favor  of  the  time-series  (TS) 
models.  The  third  general  area  of  derived  significance  involves  the  WG 
model.   BJ-WG  is  significantly  more  accurate  than  PRWll  at  horizon  3 
and  more  accurate  than  PRWIO  at  horizon  3,  4,  and  5.   Other  findings  of 
Table  5-41  show  none  of  the  nine  comparisons  at  horizon  2  is 
significant.   Of  the  nine  comparisons  at  horizons  4  and  5,  only  one  is 
significant. 
Industry  3550  Results 

Results  based  on  mean  square  error.   In  the  construction  machinery 
and  equipment  industry  (3531),  the  BJ-BR  model  has  the  smallest  MSE 
overall  and  at  each  horizon.   The  other  two  BJ  models  place  second  and 
third  with  low  MSE's  generally  across  all  strata.   Tables  5-36  and  5-50 
summarize  the  statistics  generated  for  this  industry  based  on  MSE.   The 
FOST  model  ranks  fourth  in  accuracy  overall  and  at  each  horizon.   PRWll 
is  fifth  in  all  cases,  except  horizon  2  where  it  is  sixth.   PRWIO  is 
last  in  all  cases,  except  it  is  third  at  horizon  2.  All  hypotheses 
except  Q9  are  rejected  in  favor  of  the  TS  model  at  the  industry  level. 
For  hypothesis  Q4,  which  compares  PRWll  and  WG,  the  result  is  not 
significant  at  any  horizon.   The  only  significant  difference  at  horizon 
4  results  in  rejection  of  hypothesis  Q7.   All  hypotheses  involving 
PRWIO  and  non-DLWM  models  are  rejected  at  horizon  5  while  two 


TABLE  5-35 

Industry  3531 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Absolute  Percent  Error 
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Stratum 


Model 


PRWll 


FOST 


BJ-F 


BJ-BR 


BJ-WG 


Rank 

All  horizons6  PRWIO      .3797 

5  PRWl 1 

4  FOST 

2  BJ-F 

3  BJ-BR 
1  BJ-WG 


.0206 
.2542 


.0796 
.4644 


.0767 
.4175 


.0001 
.0031 


Horizon  1 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


1.0000 


.0559 
.0559 


J473 
,1473 


.2061 
.2061 


.0243 
.0243 


Horizon  2 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.7437 


.7567 
.7698 


.5940 
.7050 


.7050 
.8498 


.3633 
.4602 


Horizon  3 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.6671 


.2807 
.3816 


.4602 
.4198 


.7830 
.6671 


.0864 
.0287 


Horizon  4 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


,1885 


.4397 
.6671 


.3724 
.7567 


.2883 
.9863 


.0777 
.3909 


Horizon  5 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.3120 


.2248 
.945 


.1521 
.6671 


.1569 
.7698 


.0625 
.4004 


TABLE  5-36 

Industry  3550 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Squared  Error 
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Stratum 


Model 


PRWll 


POST 


BJ-F 


BJ-BR 


BJ-WG 


Rank. 


All  horizons6 
5 
4 
2 


PRWIO 

PRWll 

POST 

BJ-F 

1   BJ-BR 

3   BJ-WG 


.6722 


.0034 
.0143 


.0012 
.0059 


.0006 
.0030 


.0051 
.0243 


Horizon  1 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


1.0000 


.4496 
.4496 


.5668 
.5668 


.2493 
.2493 


,2620 
.2620 


Horizon  2 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.3233 


.4533 
.1632 


.2972 
.0713 


.2806 
.0732 


.5586 
.1945 


Horizon  3 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.7616 


.0567 
.1007 


.0230 
.0474 


.0168 
.0474 


.1360 
.2620 


Horizon  4 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.2371 


.1803 
.9340 


.1632 
.7756 


.1376 
.8182 


.2094 
.9536 


Horizon  5 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.7898 


.0771 
.1688 


.0615 
.1138 


.0888 
.1287 


.0934 
.1614 
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hypotheses  involving  PRWll  also  are  rejected — all  in  favor  of  the  TS 

models.  Both  BJ-F  and  BJ-BR  are  significantly  better  than  PRWll  at 

horizon  5. 

Results  based  on  absolute  error.   In  terms  of  the  relative 
performance  of  the  various  models  overall  and  at  each  of  the  five 
horizons,  the  flAbsE  results  listed  in  Table  5-51  are  virtually  the  same 
as  the  MSE  results  of  Table  5-50.   Little  can  be  added  to  the 
evaluation  of  model  performance  based  on  analysis  of  these  data. 

Results  based  on  absolute  percent  error.   The  performances  of 
PRWll  and  PRWIO  based  on  MAfas%E  are  given  in  Tables  5-37  and  5-52. 
These  findings  are  in  direct  opposition  to  the  results  based  on  the 
other  error  measures.   PRWIO  has  the  smallest  MAbs%E  overall  and 
maintains  this  position  at  horizons  1  through  4,  then  drops  to  the 
largest  at  horizon  5.   PRWll  is  second  most  accurate  overall  and  at 
horizons  1  through  3,  while  third  best  at  horizon  4  and  fifth  best  at 
horizon  5.   The  relative  performance  of  the  other  four  models  varies 
considerably  depending  on  horizon,  but  overall  FOST  ranks  third,  BJ-WG 
fourth,  BJ-BR  fifth,  and  BJ-F  sixth. 

Many  significant  differences  in  paired  comparisons  are  identified 
overall  and  at  horizons  3  and  5.   The  first  eight  alternative 
hypotheses  can  be  supported  at  the  industry  level  with  Wilcoxon  tests 
demonstrating  the  superiority  of  PRWll  and  PRWIO  significantly 
different  than  the  other  models.   The  data  of  Table  5-37  indicate  none 
of  the  differences  are  significant  at  horizon  1.   The  only  significant 
differences  at  horizon  2  are  for  Q2  and  Q3.   The  only  nonsignificant 
differences  at  horizon  3  involve  BJ-WG.   Results  of  horizon  4  are 
mixed.   No  paired  comparisons  indicate  a  significant  difference,  except 
Q6  is  rejected  with  BJ-F  more  accurate  than  PRWIO.   In  terms  of  the 


TABLE  5-37 

Industry  3550 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Absolute  Percent  Error 
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Stratum 


Model 


PRWll 


FOST 


BJ-F 


BJ-BR 


BJ-WG 


Rank 
All  horizons  1 
2 
3 
6 
5 
4 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.8793 


.0128 
.0186 


.0011 
.0018 


.0009 
.0015 


.0071 
.0120 


Horizon  1 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


1.0000 


.4244 
.4244 


.3668 
.3668 


1632 
,1632 


.3354 
.3354 


Horizon  2 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.6569 


,4948 
.3086 


.2806 
.1045 


.2806 
.1180 


.5463 
.2184 


Horizon  3 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.7063 


.1252 
.0802 


.0694 
.0515 


.0802 
.0685 


.2972 
.2117 


Horizon  4 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.5668 


.2323 
.7710 


.1045 
.3636 


.2699 
.7246 


.2371 
.7384 


Horizon  5 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.5877 


.1058 
.2620 


.0567 
.1525 


.0530 
.1424 


.0423 
.0982 
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data  in  Table  5-52  alone,  PRWIO  never  has  a  smaller  MAbsZE  than  another 

model  at  horizon  4,  but  only  BJ-F  is  significantly  better  (Q6).   PRWll 

is  better  than  FOST  and  BJ-WG,  but  worse  than  BJ-F  and  BJ-BR.   The 

horizon  5  information  of  the  two  tables  indicates  rejection  of 

hypotheses  Q2-Q8  in  favor  of  the  time-series  models. 

Industry  3560  Results 

Results  based  on  mean  square  error.   For  the  general  industrial 
machinery  and  equipment  industry  (3560),  the  data  in  Table  5-53 
indicate  the  dominance  of  the  BJ-F  model,  while  the  DLWM  models  perform 
poorly  except  at  horizons  4  and  5.   In  terms  of  the  Wilcoxons  on  Table 
5-38,  significant  differences  are  noted  overall  and  at  horizon  1.   This 
results  in  rejection  of  null  hypotheses  Q1-Q8  for  these  two 
stratifications.   Only  five  other  individual  strata  differences  are 
significant  through  all  of  the  four  longer  horizons.   The  only 
significant  result  at  horizon  2  involves  PRWIO  and  BJ-WG.   The  other 
four  rejections  are  at  horizon  3  for  Ql,  Q4,  Q5,  and  Q8.  At  horizons  4 
and  5  there  are  no  significant  differences  identified.   However,  many 
of  these  comparisons  generally  support  the  DLWld  models. 

Results  based  on  absolute  error.  As  noted  in  other  industries, 
the  MAbsE  results  are  very  similar  to  the  MSE  results.   Table  5-54 
shows  virtually  the  same  relative  results  as  Table  5-53. 

Results  based  on  absolute  percent  error.   While  the  MAbs%E  results 
in  the  previously  discussed  industries  have  led  to  opposite  conclusions 
with  respect  to  the  hypotheses  as  do  the  other  error  measures,  the 
MAbs%E  figures  of  Table  5-55  are  reasonably  consistent  with  the  MSE  and 
MAbsE  results  for  this  industry.   The  primary  difference  is  in  the  BJ 
model,  which  performs  best.   Based  on  MAbs%E,  BJ-WG  has  the  smallest 
error  overall  and  at  horizons  1-4.   For  horizon  5,  PRWll  has  the 


TABLE  5-38 

Industry  3560 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Squared  Error 
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Stratum 


Model 


PRWll 


FOST 


BJ-F 


BJ-BR 


BJ-WG 


Rank 


All  horizonsS 

PRWIO 

6 

PRWll 

2 

FOST 

1 

BJ-F 

5 

BJ-BR 

3 

BJ-WG 

Horizon  1 

5 

PRWIO 

5 

PRWll 

3 

FOST 

1 

BJ-F 

2 

BJ-BR 

4 

BJ-WG 

Horizon  2 

5 

PRWIO 

6 

PRWll 

3 

FOST 

1 

BJ-F 

2 

BJ-BR 

4 

BJ-WG 

Horizon  3 

6 

PRWIO 

5 

PRWll 

2 

FOST 

1 

BJ-F 

4 

BJ-BR 

3 

BJ-WG 

Horizon  4 

3 

PRWIO 

2 

PRWll 

4 

FOST 

1 

BJ-F 

6 

BJ-BR 

5 

BJ-WG 

Horizon  5 

2 

PRWIO 

6 

PRWll 

3 

FOST 

1 

BJ-F 

5 

BJ-BR 

4 

BJ-WG 

.9871 


1.0000 


.5534 


.9242 


.0071 
.0089 


.0077 
.0077 


.3742 
.8725 


.0688 
.1316 


.8661 


.3688 


,3084 
.4301 


.5697 
.7869 


.1236 
.1366 


.0256 
.0256 


.4950 
.9501 


.4274 
.5194 


.5916 
.7212 


.2916 
.9282 


.1301 
.1453 


.0533 
.0533 


.3742 
.7421 


.3556 
.4531 


.5238 
.5666 


.2495 
.7486 


.0015 
.0020 


.0021 
.0021 


.1242 
.3950 


.0614 
.0967 


.5075 
.6330 


.8029 
.5093 
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smallest  MAbs%E.   PRWIO  and  PRWll  are  the  two  worst  models  until 

horizon  4.   For  this  horizon,  PRWIO  is  third  most  accurate.   The 

Wilcoxon  data  for  this  error  measure  are  presented  in  Table  5-39.   For 

the  overall  industry  sample  and  horizons  1-3,  these  results  are  exactly 

the  same  as  the  significance  measure  applied  to  MSE.   For  horizon  4,  as 

before,  none  of  the  nine  comparisons  is  significant,  but  because  of  the 

poor  ranking  of  PRWll  based  on  MAbs%E,  there  are  few  cases  in  general 

support  for  DLWM  models.  At  horizon  5,  all  comparisons  support  the 

DLWM  models,  but  no  results  are  significantly  clifferent. 

Industry  3711/3713  Group  Results 

Results  based  on  mean  square  error.   In  the  motor  vehicles,  car, 
truck,  and  bus  bodies  (3711/3713)  group,  the  non  BJ  model,  FOST,  is  the 
most  accurate  based  on  MSE.    BJ-WG  and  BJ-BR  are  second  and  third, 
respectively,  and  BJ-F  is  fourth.   This  leaves  the  two  DLWM's  last 
overall  and  at  every  horizon.   The  data  in  Table  5-56  also  indicate 
that  as  expected  (Q9),  PRWIO  is  more  accurate  than  PRWll. 

All  of  the  first  eight  hypotheses  are  rejected  at  significant 
levels  for  the  industry  group  overall  and  at  horizon  1 .   Of  the  other 
36  tests  of  hypotheses,  only  one  is  significant.   At  horizon  2,  BJ-BR 
is  significantly  more  accurate  than  PRWll.  All  other  tests  at  horizon 
2  and  all  tests  at  horizons  3,  4,  and  5  show  no  significant  differences 
in  the  models  compared.   These  numbers  are  contained  in  Table  5-40. 

Results  based  on  absolute  error.   The  MAbsE  results  of  Table  5-57 
give  the  same  relative  accuracy  as  the  MSE  figures  in  Table  5-56. 

Results  based  on  absolute  percent  error.   The  three  BJ  models  lead 
the  MAbs%E  statistics  in  accuracy  according  to  the  results  listed  in 
Table  5-58.   BJ-F  is  most  accurate  followed  by  BJ-BR  and  then  BJ-WG. 


TABLE  5-39 

Industry  3560 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Absolute  Percent  Error 
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Stratum 


Model 


Rank 
All  horizons5 
6 
4 
2 
3 
1 


PRWIO 

PRWU 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


PRWll 


.4983 


FOST 


BJ-F 


.0013 
.0054 


.0158 
.0759 


BJ-BR 


.0266 
.1041 


BJ-WG 


.0001 
.0006 


Horizon  1 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


1.0000 


.0030 
.0030 


.0044 
.0044 


.0066 
.0066 


.0004 
.0004 


Horizon  2 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.3335 


.2312 
.7054 


.3670 
.8918 


.2761 
.9090 


.0595 
.3162 


Horizon  3 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.7586 


.0961 
.1275 


.2773 
.3935 


.2229 
.3684 


.0368 
.0592 


Horizon  4 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.4060 


.1482 
.4967 


.2630 
.8617 


.2422 
.7594 


.2979 
.7658 


Horizon  5 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.5838 


.7778 
.6083 


.4832 
.9024 


.1757 
.4212 


.9423 
.4060 


TABLE  5-40 

Industries  3711  and  3713 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Squared  Error 
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Stratum 


Model 


PRWU 


FOST 


BJ-F 


BJ-BR 


BJ-WG 


Rank 

All   horlzons6 

PRWIO 

5 

PRWU 

1 

FOST 

4 

BJ-F 

3 

BJ-BR 

2 

BJ-WG 

Horizon   1 

5 

PRWIO 

5 

PRWU 

1 

FOST 

4 

BJ-F 

3 

BJ-BR 

2 

BJ-WG 

Horizon  2 

6 

PRWIO 

5 

PRWU 

1 

FOST 

4 

BJ-F 

2 

BJ-BR 

3 

BJ-WG 

Horizon  3 

6 

PRWIO 

5 

PRWU 

1 

FOST 

4 

BJ-F 

2 

BJ-BR 

3 

BJ-WG 

Horizon  4 

6 

PRWIO 

5 

PRWU 

2 

FOST 

3 

BJ-F 

1 

BJ-BR 

4 

BJ-WG 

Horizon  5 

6 

PRWIO 

5 

PRWU 

1 

FOST 

3 

BJ-F 

4 

BJ-BR 

2 

BJ-WG 

.9135 


1.0000 


.7804 


.9207 


.8547 


.8607 


.0299 
.0380 


.0760 
.0760 


.3404 
.2190 


.4094 
.4801 


.4140 
.5397 


.6316 
.6399 


.0030 
.0029 


.0410 
.0410 


.2581 
.1750 


.3208 
.3256 


,2738 
.3180 


.1812 
.2442 


.0080 
.0069 


.0449 
.0449 


.1910 
.1074 


.5374 
.5051 


.3859 

.4326 


.2585 
.4072 


.0183 
.0224 


.0972 
.0972 


.4094 
.2838 


.5115 
.4679 


.4452 
.5326 


.2888 
.2634 
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There  is  some  variation  across  horizons,  however.   The  two  DLWM  models 

consistently  are  the  worst.   The  result  generally  leads  to  rejection  of 

hypotheses  Q1-Q8.  Most  of  the  Wilcoxons  of  Table  5-41  are  significant, 

although  scattered,  nonsignificant  findings  can  be  found  at  various 

horizons.   BJ-BR  and  BJ-WG  are  not  significantly  better  than  PRWll  at 

horizons  above  2.   The  FOST  model  is  not  significantly  better  than 

PRWll  above  horizon  3.   For  comparisons  involving  PRWIO,  the  results 

are  quite  similar;  however  three  exceptions  do  exist.   All  three  of 

these  exceptions  are  at  horizon  5.   On  the  positive  side,  PRWIO  ranks 

fourth  and  FOST  fifth  with  the  difference  insignificant.   On  the 

negative  side,  PRWIO  is  significantly  less  accurate  than  the  BJ-BR  and 

BJ-WG  models  at  this  horizon. 

Summary  of  the  Quarterly  Results 

The  findings  across  the  four  industries  and  within  industry  have 
been  contradictory.  Many  of  these  inconsistencies  have  resulted  from 
the  relative  performance  of  the  various  models  based  on  different  error 
measures.   These  inconsistencies  are  summarized  in  Table  5-42.   The 
rankings  in  this  table  indicate  that  the  two  DLWM  models  did  well 
occasionally  in  each  industry.   They  also  ranked  last  many  times.   The 
relative  performance  of  the  other  four  models  shows  no  dominance  by  any 
one  of  them. 

The  general  comments  that  can  be  made  on  the  basis  of  analysis  of 
Table  5-42  are  as  follows.   The  DLWM  models  perform  the  worst  in 
industry  group  3711/3713,  the  industry  in  which  FOST  does  best.   There 
are  many  instances  where  one  set  of  models  maintains  some  superiority 
at  horizons  1-3  but  does  not  maintain  this  relative  advantage  at  longer 
horizons.   The  primary  example  of  this  is  in  industry  3560  where,  after 
being  last  through  horizon  4,  PRWll  is  most  accurate  at  horizon  5.   For 


TABLE  5-41 

Industries  3711  and  3713 

Significance  Level  (p-value)  of  Paired  Wilcoxon  Test 

Mean  Absolute  Percent  Error 
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Stratum 


Model 


PRWll 


POST 


BJ-F 


BJ-BR 


BJ-WG 


Rank 
All  horizons5 
6 
3 
1 
2 
4 


PRWIO 

PRWll 

POST 

BJ-F 

BJ-BR 

BJ-WG 


.6706 


.0007 
.0019 


.0001 
.0001 


.0001 
.0001 


.0002 
.0004 


Horizon  1 


PRWIO 

PRWll 

POST 

BJ-F 

BJ-BR 

BJ-WG 


1.0000 


.0155 
.015 


.0015 
.0015 


.0029 
.0029 


.0118 
.0118 


Horizon  2 


PRWIO 

PRWll 

POST 

BJ-F 

BJ-BR 

BJ-WG 


.9682 


.2012 
.1406 


.0514 
.0237 


.0249 
.0069 


.1032 
.0449 


Horizon  3 


PRWIO 

PRWll 

POST 

BJ-F 

BJ-BR 

BJ-WG 


.8655 


,1380 
,1329 


,1231 
,1459 


,1877 
,2708 


.1910 
.2419 


Horizon  4 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.7143 


,1949 
.3232 


.0348 
.0625 


,1706 
.2785 


.2691 
.3725 


Horizon  5 


PRWIO 

PRWll 

FOST 

BJ-F 

BJ-BR 

BJ-WG 


.6652 


.3507 
.6567 


.0341 
.1256 


.0953 
.2537 


.0730 
.2442 
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TABLE  5-42 
Summary  of  Quarterly  Results :   Rankings 


Mean   Square 

Error 

3531 

3550 

3560 

3711/3713 

0_ 

12  3  4 

_5 

0_ 

12  3  4 

_5 

0 

1   2  3 

_4_ 

_5 

0_ 

12  3  4  5 

PRWIO 

PRWll 

Fost 

BJ-F 

BJ-BR 

BJ-WG 

5 
1 
3 
4 
6 
2 

12  3  6 

114  4 

3  4   11 
5   5  5  2 

4  6  6  5 
2  3  2  3 

6 

1 
4 
3 
5 
2 

6 
5 
4 
2 
1 
3 

5   3  6  6 
5  6  5  5 

4  4  4  4 
3   2  2   2 
1111 
2   5   3  3 

6 
5 

4 
3 

1 
2 

5 
6 
2 
1 
4 
3 

5   5  6 
5  6   5 

3  3   2 

1  1    1 

2  2  4 

4  4  3 

3 
2 

4 
1 
6 
5 

2 
6 
3 

1 
5 
4 

6 
5 
1 
4 
3 
2 

5  6  6   6  6 
5  5  5  5  5 
1112   1 
4  4  4  3  3 
3   2  2    14 
2  3  3  4  2 

Mean  Absolute  Error 


3531 

3550 

3560 

3711/3713 

0_ 

12  3  4  5 

0_ 

12   3  4  5 

0_ 

12  3  4  5 

0_ 

12  3  4  5 

PRWIO 

PRWll 

Fost 

BJ-F 

BJ-BR 

BJ-WG 

6 
2 
3 

5 
4 
1 

2   2  3   6   6 

2  14  5  4 

4  4    14   5 

5  6  5  2   1 

3  5  6  3  3 
13  2   12 

6 
5 
4 
2 
1 
3 

5   4  6   6  6 
5   6   5  5  5 
4   5  4   14 
3   2   2  3  3 
1112   1 
2  3  3  4   2 

5 
6 
3 
1 
4 
2 

5   6  5  5  2 

5   5  6   2  6 

3  3   14  4 
12  3   11 

4  4  4  6   5 
2    12  3   3 

6 

5 
1 
4 
3 
2 

5  6  6   6  5 
5  5  5  5  6 
1112  2 
4  4  4  3  3 
3  2  3   14 
2  3   2  4   1 

Mean  Absolute  Percent  Error 


3531 

3550 

3560 

3711/3713 

0_ 

12  3  4 

_5 

0_ 

12  3  4   5 

0_ 

12  3  4  5 

_0_ 

12  3  4  5 

PRWIO 

PRWll 

Fost 

BJ-F 

BJ-BR 

BJ-WG 

6 

5 
4 
2 
3 

1 

5   5  6  4 
5   6   5   1 

3  4   2  6 
2   3  3  3 

4  2   4   5 
1112 

6 
5 
4 
2 
3 
1 

1 
2 
3 
6 

5 
4 

1116  6 
12  2   3  5 

2  3  6   5  3 
5   6   4   12 
4   5   5   2    1 

3  4   3  4  4 

5 
6 
4 
2 
3 
1 

5   6  5  3   2 
5   5  6  6   1 
4  4   2   5  6 

2  2  3   2  4 

3  3  4  4  5 
11113 

5 
6 

4 
1 
2 
3 

5  5  6  6  4 
5   6   5   5  6 
4   3   13   5 
12  2  2   1 

2  13   12 

3  4  4  4  3 

Column  headings; 


0  =  all  horizons  (i.e.,  all  predictions  for  the 

industry 
1-5  =  horizons  1  to  5 
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industry  3550,  the  MAbs%E  rankings  show  PRWIO  first  at  horizons  1-3  and 

last  at  horizons  4  and  5.   Somewhat  similar  results  hold  for  industry 

3531  based  on  both  MSE  and  MAbsE. 

In  order  to  understand  better  the  results  of  the  many  hypothesis 
tests  which  have  been  conducted,  a  series  of  four  additional  tables  is 
presented.   Table  5-43  summarizes  industry  3531  hypothesis  tests. 
Because  of  the  favorable  ranking  based  on  MSE  and  the  lack  of 
significant  findings  in  many  cases  based  on  MAbs%E,  the  conclusion  must 
be  in  support  of  the  DLWM  model.   For  industry  3550,  the  data  in  Table 
5-44  lead  to  a  somewhat  similar  conclusion.   In  this  case,  however,  the 
favorable  rankings  are  based  on  MAbs%E,  and  there  are  a  few  more 
individual  strata  rejections  of  hypotheses. 

The  summary  of  the  hypothesis  testing  for  industry  3560  is 
contained  in  Table  5-45.   The  results  are  mixed.   Both  error  measures 
result  in  rejection  of  hypotheses  Q1-Q8  overall  and  at  horizon  1 
without  exception.  At  horizons  3  and  4,  almost  all  differences  between 
models  are  insignificant.   At  horizons  4  and  5,  only  1  of  36 
comparisons  shows  a  significant  difference,  but  the  dominance  by  the 
DLWM  models  exists  nonetheless. 

The  performance  of  DLWM  models  in  industry  group  3711/3713  is  the 
worst  of  the  four  industries.   The  hypothesis  summary  in  Table  5-46 
confirms  this.   The  only  encouraging  sign  is  the  lack  of  significance 
shown  generally  for  horizons  2-5.   This  is  especially  true  based  of  MSE 
and  somewhat  true  based  on  MAbs%E  for  horizons  3-5.   An  exception  is 
the  dominance  of  the  BJ-F  model  at  all  horizons.   Even  in  this  industry 
group,  the  conclusion  can  be  favorable  to  the  DLWM  due  to  the  lack  of 
rejection  of  hypotheses  in  so  many  cases. 
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Frame  1 


Stratum 


TABLE  5-43 

Summary  of  Hypothesis  Testing 

Construction  Machinery  and  Equipment 

Industry  3531 


Mean  Squared  Error 
Hypotheses 
123456789 
11/Fost      U/F      11/BR      11/WG      10/For      10/F      10/BR      10/WG      10/11 


Industry 

A 

.10 

A 

A 

A 

.10 

R  .005 

R 

.02 

A 

.02 

R. 

0004 

- 

Horizon  1 

A 

.11 

A 

A 

A. 

05 

A  .11 

A 

A 

A 

.05 

N/A 

Horizon  2 

A 

A 

A 

A 

A 

A 

A 

A 

.15 

- 

Horizon  3 

R 

.13 

A 

A 

- 

R  .13 

A 

A 

- 

- 

Horizon  4 

- 

- 

A 

- 

- 

- 

- 

R 

.08 

- 

Horizon  5 

A 

A 

A 

A 

_ 

R 

.07 

R 

.07 

R 

.09 

0 

Frame  2 


Stratum 


Mean  Absolute  Percent  Error 
Hypotheses 
123456789 
11/Fost   U/F   11/BR   11/WG   10/For   10/F   10/BR   10/WG  10/11 


Industry    -  - 

Horizon  1  R  .05  R  .14 

Horizon  2   -  - 

Horizon  3   -  - 

Horizon  4   A  A 

Horizon  5   -  - 


R  .003  R  .02  R  .07   R  .07   R.OOOl 

R  .02   R  .05  R  .14    -    R  .02   N/A 


R  .02 
A 


R  .08 

R  .07    0 

R  .06 


Notation  is  defined  on  page  167. 
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Legend  for  Tables  5-43  through  5-46 
Entries  in  table  from  least  favorable  to  most  favorable: 

Notation  Meaning 

R(.XXXX)  Null  hypothesis  is  rejected  at  significance  level  less 
than  fifteen  percent  and  the  result  is  the  opposite  of 
what  was  expected. 

Wilcoxon  test  is  insignificant,  but  direction  is  non 
supportive  of  the  DL  model. 

0         In  the  case  of  hypothesis  A4  (comparing  PRWIO  and  PRWll), 
the  result  is  the  £^pposite  of  what  was  expected. 

N/A        At  horizon  1  models  PRWIO  and  PRWll  are  the  same. 

A  While  the  Wilcoxon  is  non  significant,  the  DLWM  model  must 
be  accepted  due  to  the  relative  accuracy  of  the  two  models 
being  compared. 

A(.XXXX)     Not  only  is  the  result  in  support  of  the  DLWM  model, 
but  there  is  an  Indication  of  a  significant  (<  .1500) 
level  of  difference.   The  null  is  rejected  favorably. 
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TABLE  5-44 

Summary  of  Hypothesis  Testing 

Special  Industry  Machinery 

Industry  3550 


Frame  1 


Mean  Squared  Error 
Stratum  Hypotheses 

123456789 
11/Fost      U/F      11/BR      11/WG      10/For      10/F      10/BR      10/WG      10/11 
Industry     R   .01      R   .005   R   .003   R   .02      R   .003   R   .001   R.0006   R   .005 


Horizon   1        -  - 

Horizon  2       -  R   .07     R   .07 

Horizon   3   R   .10  R   .04      R   .04 

Horizon  4       -  - 

Horizon  5       -  R  .11      R  .12 


A/A 


A              -  -              A 

R   .05      R   .02  R   .01  R   .13 

-  R   .13          - 

R   .07      R   .06  R   .08  R   .09 


Frame   2 

Mean  Absolute  Percent   Error 

Stratum  Hypotheses 

123456789 

11/Fost   U/F   U/BR  11/WG   10/For   10/F   10/BR   10/WG   10/11 

Industry  A  .01   A  .001  A  .001  A  .01   A  .01   A  .001  A.0009  A  .007 

Horizon   lAAAAAAAA  N/A 

Horizon  2   A    A  .10  A  .11    A      A      A      A      A 

Horizon  3  A  .08  A  .05  A  .06    A    A  .12  A  .06   A  .08    A 

Horizon  4A      -      -      A      -R.IO- 

Horizon  5   -    R  .15   R  .14  R  .09   R  .10   R  .05   R  .05   R  .04 


Notation  is  defined  on  page  167. 
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TABLE  5-45 

Sunmary  of  Hypothesis  Testing 

General  Industrial  Machinery  and  Equipment 

Industry  3560 


Frame  1 


Mean  Squared  Error 
Stratum  Hypotheses 

123456789 
11/Fost   11/F   11/BR   11/WG   10/For   10/F   10/BR   10/WG   10/11 
Industry  R  .008  R  .13  R  .14  R  .002  R  .007  R  .12  R  .13  R  .001 
Horizon  1  R  .007  R  .02  R  .05  R  .002  R  .007  R  .02  R  .05  R  .002  N/A 
Horizon  2-      -      -      -      -      -      -R.12- 

Horlzon  3  R  .13    -      -    R  .09  R  .06    -      -    R  .06 
Horizon  4A-AAA-AA- 
Horizon  5----A-AA- 

Frame   2 

Mean  Absolute  Percent  Error 

Stratum  Hypotheses 

123456789 

11/Fost   U/F   11/BR   11/WG   10/For   10/F   10/BR   10/WG  10/11 

Industry  R  .005  R  .07  R  .10  R.0006  R  .001  R  .01  R  .02  R.OOOl 

Horizon  1  R  .003  R  .004  R  .006  R.0004  R  .003  R  .004  R  .006  R.0004  N/A 

Horizon  2-      -      -      -      -      -      -R.05- 

Horizon  3  R  .12    -      -    R  .05  R  .09    -      -    R  .03 

Horizon  4-      -      -      -A.  14-      A 

Horizon  5AAAAAAAA- 


Notation  is  defined  on  page  167 • 
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TABLE  5-46 

Summary  of  Hypothesis  Testing 

Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 

Industries  3711  and  3713 


Frame  1 


Mean  Squared  Error 
Stratum  Hypotheses 

123456789 
11/Fost   11/F   11/BR   11/WG   10/For   10/F   10/BR   10/WG   10/11 
Industry  R  .03  R  .002  R  .006  R  .02   R  .02  R  .003  R  .008  R  .01 
Horizon  1  R  .07   R  .04  R  .04  R  .09   R  .07   R  .04  R  .04  R  .09   N/A 
Horizon  2-      -R.IO- 
Horizon  3--------- 

Horizon  4--------- 

Horizon  5--------- 

Frame  2 

Mean  Absolute  Percent  Error 

Stratum  Hypotheses 

123456789 

11/Fost   11/F  U/BR  U/WG   10/For   10/F   10/BR  lO/WG   10/11 

Industry  R.0019  R.OOOl  R.OOOl  R.0004  R.0007  R.OOOl  R.OOOl  R.0002 

Horizon  1  R  .01   R  .001  R  .002  R  .01   R  .01   R  .001  R  .002  R  .01   N/A 

Horizon  2  R  .14  R  .02  R  .006  R  .04    -    R  .05  R  .02  R  .10 

Horizon  3  R  .13   R  .14  -  -    R  .13   R  .12    - 

Horizon  4   -    R  .06  -  -      -    R  .03    - 

Horizon  5   -    R  .12  -  -      A    R  .03  R  .09  R  .07 

Notation  is  defined  on  page  167- 
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Summary  of  Empirical  Work  and  Results 

The  three  samples  present  a  strong  case  for  the  continued  use  and 

further  investigation  of  DLWM  models.   The  Sample  #1  results  indicate 

mixed  findings  while  the  relative  performance  of  PRWIO  and  PRWll  is 

especially  strong  in  industry  group  3711/3713.   The  strength  of  the 

DLWM  models  is  relatively  less  in  annual  Sample  #2  for  this  industry. 

In  the  quarterly  sample,  the  performance  of  the  DLWM  models  is  worse  in 

this  group  than  in  any  of  the  other  industries.   As  this  example 

indicates,  the  results  are  inconsistent.   Time  and  again,  when  one  set 

of  models  performs  well  in  a  particular  case,  another  set  of  models  out 

performs  them  in  another  case.   This  is  true  between  horizons,  between 

error  measures,  between  industries,  and  between  samples.   One  must 

exercise  care  when  drawing  conclusions  based  on  such  inconsistent 

findings.   The  process  of  arriving  at  a  set  of  conclusions  is 

presented  in  the  following  chapter. 
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TABLE  5-47 

Mean  Sqxiare  Error  for  Industry  3531 
Construction  Machinery  and  Equipment 


Stratum 

Model 

Rank 

MSE 

Industry 

PRWIO 

5 

96.6018 

3531 

PRWll 

1 

55.6225 

(obs=135) 

FOST 

3 

77.4448 

BJ-F 

4 

91.7538 

BJ-BR 

6 

109.9840 

BJ-WG 

2 

64.2544 

Stratum 

Model 
PRWIO 

Rank 

5 

MSE 

Stratum 
Horizon 

Model 

Rank 

MSE 

Base  752 

62.0356 

PRWIO 

1 

53.6609 

(obs=45) 

PRWll 

4 

53.0805 

1 

PRWll 

1 

53.6609 

FOST 

6 

150.1653 

(obs=27) 

FOST 

3 

84.4569 

BJ-F 

3 

51.6573 

BJ-F 

5 

88.6363 

BJ-BR 

2 

46.2076 

BJ-BR 

4 

87.1807 

BJ-WG 

1 

33.5252 

BJ-WG 

2 

63.6072 

Base  753 

PRWIO 

6 

94.5746 

Horizon 

PRWIO 

2 

23.1497 

(obs=45) 

PRWll 

5 

62.6740 

2 

PRWll 

1 

15.3709 

FOST 

4 

47.4118 

(obs=27) 

FOST 

4 

117.6483 

BJ-F 

3 

46.4332 

BJ-F 

5 

152.2379 

BJ-BR 

2 

44.2618 

BJ-BR 

6 

152.8525 

BJ-WG 

1 

29.6984 

BJ-WG 

3 

86.8061 

Base  754 

PRWIO 

4 

133.1953 

Horizon 

PRWIO 

3 

41.0481 

(obs=45) 

PRWll 

2 

51.1129 

3 

PRWll 

4 

47.7098 

FOST 

1 

34.7572 

(obs=27) 

FOST 

1 

26.7902 

BJ-F 

5 

177.1710 

BJ-F 

5 

80.7492 

BJ-BR 

6 

239.4825 

BJ-BR 

6 

92.2420 

BJ-WG 

3 

129.5396 

BJ-WG 

2 

33.7467 

Horizon 

PRWIO 

6 

223.1713 

Horizon 

PRWIO 

6 

141.9792 

5 

PRWll 

1 

64.3777 

4 

PRWll 

4 

96.9930 

(obs=27) 

FOST 

4 

105.4625 

(obs=27) 

FOSTl 

1 

52.8661 

BJ-F 

3 

76.2973 

BJ-F 

2 

60.8484 

BJ-BR 

5 

120.1292 

BJ-BR 

5 

97.5155 

BJ-WG 

2 

74.6470 

BJ-WG 

3 

62.4651 

TABLE  5-48 

Mean  Absolute  Error  for  Industry  3531 
Construction  Machinery  and  Equipment 


Stratvim 


Model 


Rank 


MAbsE 


Industry 

PRWIO 

6 

4.3030 

3531 

PRWll 

2 

3.6320 

(obs=135) 

FOST 

3 

3.7777 

BJ-F 

5 

4.0976 

BJ-BR 

4 

4.0418 

BJ-WG 

1 

3.2307 
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Stratum 

Model 

Rank 

MAbsE 

Base  752 

PRWIO 

4 

3.7027 

(obs=45) 

PRWll 

5 

3.7417 

FOST 

6 

4.9160 

BJ-F 

3 

3.0528 

BJ-BR 

2 

2.6089 

BJ-WG 

1 

2.2445 

Base  753 

PRWIO 

6 

4.6607 

(obs=45) 

PRWll 

5 

4.1736 

FOST 

4 

3.5721 

BJ-F 

2 

2.8982 

BJ-BR 

3 

2.9570 

BJ-WG 

1 

2.3678 

Base  754 

PRWIO 

3 

4.5455 

(obs=45) 

PRWll 

2 

2.9807 

FOST 

1 

2.8449 

BJ-F 

5 

6.3418 

BJ-BR 

6 

6.5595 

BJ-WG 

4 

5.0799 

Horizon 

PRWIO 

6 

6.9051 

5 

PRWll 

4 

3.8196 

(obs=27) 

FOST 

5 

4.6293 

BJ-F 

1 

3.4752 

BJ-BR 

3 

3.7865 

BJ-WG 

2 

3.4790 

Stratum 

Model 

Rank 

MAbsE 

Horizon 

PRWIO 

2 

3.9455 

1 

PRWll 

2 

3.9455 

(obs=27) 

FOST 

4 

4.1591 

BJ-F 

4 

4.1991 

BJ-BR 

3 

4.0911 

BJ-WG 

1 

3.4766 

Horizon 

PRWIO 

2 

2.9012 

2 

PRWll 

1 

2.4161 

(obs=27) 

FOST 

4 

4.5220 

BJ-F 

6 

6.0057 

BJ-BR 

5 

5.3391 

BJ-WG 

3 

4.0692 

Horizon 

PRWIO 

3 

3.0191 

3 

PRWll 

4 

3.6478 

(obs=27) 

FOST 

1 

2.1068 

BJ-F 

5 

3.8249 

BJ-BR 

6 

3.9193 

BJ-WG 

2 

2.5412 

Horizon 

PRWIO 

6 

4.7439 

4 

PRWll 

5 

4.3310 

(obs=27) 

FOSTl 

4 

3.4713 

BJ-F 

2 

2.9830 

BJ-BR 

3 

3.0731 

BJ-WG 

1 

2.5877 

TABLE  5-49 

Mean  Absolute  Percent  Error  for  Industry  3531 
Construction  Machinery  and  Equipment 


Stratum 


Model 


Rank. 


MAbs%E 


Industry 

PRWIO 

6 

0.6892 

3531 

PRWll 

5 

0.6631 

(obs=135) 

FOST 

4 

0.5232 

BJ-F 

2 

0.4707 

BJ-BR 

3 

0.4915 

BJ-WG 

1 

0.3318 
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Stratum 

Model 
PRWIO 

Rank 
6 

MAbs%E 
0.7076 

Stratum 
Horizon 

Model 
PRWIO 

Rank 

MAbs%E 

Base  752 

5 

0.8867 

(obs=45) 

PRWll 

5 

0.7073 

1 

PRWll 

5 

0.8867 

FOST 

4 

0.4513 

(obs=27) 

FOST 

3 

0.5558 

BJ-F 

3 

0.3803 

BJ-F 

2 

0.5360 

BJ-BR 

2 

0.3467 

BJ-BR 

4 

0.5703 

BJ-WG 

1 

0.2213 

BJ-WG 

1 

0.3077 

Base  753 

PRWIO 

6 

0.8573 

Horizon 

PRWIO 

5 

0.7186 

(obs=45) 

PRWll 

5 

0.7890 

2 

PRWll 

6 

0.8040 

FOST 

4 

0.7135 

(obs=27) 

FOST 

4 

0.6072 

BJ-F 

2 

0.5005 

BJ-F 

3 

0.5776 

BJ-BR 

3 

0.5056 

BJ-BR 

2 

0.4920 

BJ-WG 

1 

0.3237 

BJ-WG 

1 

0.2879 

Base  754 

PRWIO 

4 

0.5027 

Horizon 

PRWIO 

6 

0.5224 

(obs=45) 

PRWll 

3 

0.4930 

3 

PRWll 

5 

0.5216 

FOST 

1 

0.4047 

(obs=27) 

FOST 

2 

0.2999 

BJ-F 

5 

0.5312 

BJ-F 

3 

0.3228 

BJ-BR 

6 

0.6212 

BJ-BR 

4 

0.3549 

BJ-WG 

2 

0.4505 

BJ-WG 

1 

0.2606 

Horizon 

PRWIO 

6 

0.9241 

Horizon 

PRWIO 

5 

0.3943 

5 

PRWll 

5 

0.7974 

4 

PRWll 

1 

0.3059 

(obs=27) 

FOST 

4 

0.7337 

(obs=27) 

FOSTl 

6 

0.4192 

BJ-F 

2 

0.5662 

BJ-F 

3 

0.3501 

BJ-BR 

3 

0.6236 

BJ-BR 

5 

0.4167 

BJ-WG 

1 

0.4920 

BJ-WG 

2 

0.3109 
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TABLE  5-50 

Mean  Square  Error  for  Industry  3550 
Special  Industry  Machinery 


Stratum 

Model 

Rank 

MSE 

Industry 

PRWIO 

6 

5.8806 

3550 

PRWll 

5 

5.0599 

(obs=270) 

FOST 

4 

2.6787 

BJ-F 

2 

1.7360 

BJ-BR 

1 

1.3230 

BJ-WG 

3 

1.9084 

Stratum 

Model 
PRWIO 

Rank. 
6 

MSE 
4.6325 

Stratum 
Horizon 

Model 

Rank 

MSE 

Base  752 

PRWIO 

5 

5.8378 

(obs=90) 

PRWll 

5 

4.1688 

1 

PRWll 

5 

5.8378 

FOST 

4 

2.4787 

(obs=54) 

FOST 

4 

1.5213 

BJ-F 

2 

1.5708 

BJ-F 

3 

1.4937 

BJ-BR 

1 

0.9796 

BJ-BR 

1 

1.1053 

BJ-WG 

3 

1.6793 

BJ-WG 

2 

1.4026 

Base  753 

PRWIO 

6 

5.7460 

Horizon 

PRWIO 

3 

2.1104 

(obs=90) 

PRWll 

5 

5.5926 

2 

PRWll 

6 

2.7906 

FOST 

4 

3.0409 

(obs=54) 

FOST 

4 

2.2868 

BJ-F 

3 

2.1679 

BJ-F 

2 

1.7336 

BJ-BR 

1 

1.5659 

BJ-BR 

1 

1.4034 

BJ-WG 

2 

1.6743 

BJ-WG 

5 

2.5497 

Base  754 

PRWIO 

6 

7.2633 

Horizon 

PRWIO 

6 

9.2129 

(obs=90) 

PRWll 

5 

5.4184 

3 

PRWll 

5 

8.0599 

FOST 

4 

2.5165 

(obs=54) 

FOST 

4 

1.8790 

BJ-F 

2 

1.4693 

BJ-F 

2 

0.9451 

BJ-BR 

1 

1.4235 

BJ-BR 

1 

0.5526 

BJ-WG 

3 

2.3717 

BJ-WG 

3 

1.4141 

Horizon 

PRWIO 

6 

9.9226 

Horizon 

PRWIO 

6 

2.3192 

5 

PRWll 

5 

6.3662 

4 

PRWll 

5 

2.2452 

(obs=54) 

FOST 

4 

5.5566 

(obs=54) 

FOSTl 

4 

2.1497 

BJ-F 

3 

2.6969 

BJ-F 

2 

1.8109 

BJ-BR 

1 

1.8077 

BJ-BR 

1 

1.7459 

BJ-WG 

2 

2.1513 

BJ-WG 

3 

2.0246 

TABLE  5-51 

Mean  Absolute  Error  for  Industry  3550 
Special  Industry  Machinery 


Stratum 


Model 


Rank 


MAbsE 


Industry 

PRWIO 

6 

1.2336 

3550 

PRWU 

5 

1.1653 

(obs=270) 

FOST 

4 

0.8515 

BJ-F 

2 

0.7525 

BJ-BR 

1 

0.6762 

BJ-WG 

3 

0.7661 
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Stratum 

Model 
PRWIO 

Rank 
6 

MAbsE 
1.1420 

Stratum 
Horizon 

Model 
PRWIO 

Rank 

MAbsE 

Base  752 

5 

1.2046 

(obs=90) 

PRWll 

5 

1.0738 

1 

PRWll 

5 

1.2046 

FOST 

4 

0.8351 

(obs=54) 

FOST 

4 

0.6843 

BJ-F 

2 

0.6716 

BJ-F 

3 

0.6805 

BJ-BR 

1 

0.5499 

BJ-BR 

1 

0.5673 

BJ-WG 

3 

0.6891 

BJ-WG 

2 

0.6106 

Base  753 

PRWIO 

5 

1.2331 

Horizon 

PRWIO 

4 

0.8276 

(obs=90) 

PRWll 

6 

1.2549 

2 

PRWll 

6 

1.0068 

FOST 

4 

0.9515 

(obs=54) 

FOST 

5 

0.8517 

BJ-F 

3 

0.8422 

BJ-F 

2 

0.7304 

BJ-BR 

1 

0.7163 

BJ-BR 

1 

0.6804 

BJ-WG 

2 

0.7302 

BJ-WG 

3 

0.8163 

Base  754 

PRWIO 

6 

1.3258 

Horizon 

PRWIO 

6 

1.3628 

(obs=90) 

PRWll 

5 

1.1672 

3 

PRWll 

5 

1.2761 

FOST 

3 

0.7680 

(obs=54) 

FOST 

4 

0.7098 

BJ-F 

1 

0.7438 

BJ-F 

2 

0.5733 

BJ-BR 

2 

0.7625 

BJ-BR 

1 

0.4715 

BJ-WG 

4 

0.8791 

BJ-WG 

3 

0.6702 

Horizon 

PRWIO 

6 

1.7660 

Horizon 

PRWIO 

6 

1.0070 

5 

PRWll 

5 

1.4524 

4 

PRWll 

5 

0.8864 

(obs=54) 

FOST 

4 

1.2172 

(obs=54) 

FOSTl 

1 

0.7947 

BJ-F 

3 

0.9645 

BJ-F 

3 

0.8140 

BJ-BR 

1 

0.8509 

BJ-BR 

2 

0.8109 

BJ-WG 

2 

0.9075 

BJ-WG 

4 

0.8258 
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TABLE  5-52 

Mean  Absolute  Percent  Error  for  Industry  3550 
Special  Industry  Machinery 


Stratum 

Model 

Rank 

MAbs%E 

Industry 

PRWIO 

1 

1.7709 

3550 

PRWll 

2 

1.7768 

(obs=270) 

FOST 

3 

1.9335 

BJ-F 

6 

2.0706 

BJ-BR 

5 

1.9927 

BJ-WG 

4 

1.9668 

Stratum 

Model 
PRWIO 

Rank. 

MAbs%E 

Base  752 

3 

1.5013 

(obs=90) 

PRWll 

2 

1.5077 

FOST 

6 

1.8630 

BJ-F 

4 

1.5177 

BJ-BR 

1 

1.4775 

BJ-WG 

5 

1.5381 

Base  753 

PRWIO 

2 

1.6470 

(obs=90) 

PRWll 

1 

1.5969 

FOST 

3 

1.9307 

BJ-F 

6 

2.1108 

BJ-BR 

5 

2.0268 

BJ-WG 

4 

1.9948 

Base  754 

PRWIO 

2 

2.1643 

(obs=90) 

PRWll 

3 

2.2257 

FOST 

1 

2.0069 

BJ-F 

6 

2.5832 

BJ-BR 

5 

2.4738 

BJ-WG 

4 

2.3676 

Horizon 

PRWIO 

6 

2.4335 

5 

PRWll 

5 

2.4171 

(obs=54) 

FOST 

3 

1.7545 

BJ-F 

2 

1.7513 

BJ-BR 

1 

1.6452 

BJ-WG 

4 

1.9174 

Stratum 

Model 

Rank 

MAbs%E 

Horizon 

PRWIO 

1 

2.0004 

1 

PRWll 

1 

2.0004 

(obs=54) 

FOST 

2 

2.0807 

BJ-F 

5 

2.7579 

BJ-BR 

4 

2.5533 

BJ-WG 

3 

2.2155 

Horizon 

PRWIO 

1 

1.7286 

2 

PRWll 

2 

1.8921 

(obs=54) 

FOST 

3 

2.4450 

BJ-F 

6 

2.6722 

BJ-BR 

5 

2.5147 

BJ-WG 

4 

2.4590 

Horizon 

PRWIO 

1 

1.5316 

3 

PRWll 

2 

1.5779 

(obs=54) 

FOST 

6 

2.3053 

BJ-F 

4 

2.2401 

BJ-BR 

5 

2.2629 

BJ-WG 

3 

2.1841 

Horizon 

PRWIO 

6 

1.1602 

4 

PRWll 

3 

0.9963 

(obs=54) 

FOSTl 

5 

1.0822 

BJ-F 

2 

0.9314 

BJ-BR 

1 

0.9874 

BJ-WG 

4 

1.0583 
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TABLE  5-53 

Mean  Square  Error  for  Industry  3560 
General  Industrial  Machinery  and  Equipment 


Stratum 

Model 

Rank 

MSE 

Industry 

PRWIO 

5 

6.8135 

3560 

PRWll 

6 

7.6913 

(obs=458) 

FOST 

2 

3.9428 

BJ-F 

1 

2.3563 

BJ-BR 

4 

5.7809 

BJ-WG 

3 

4.5268 

Stratum   Model   Rank 


MSE 


Base  752 

PRWIO 

4 

4.8689 

(obs=155) 

PRWll 

6 

5.5927 

FOST 

5 

5.1827 

BJ-F 

1 

2.2709 

BJ-BR 

2 

2.8451 

BJ-WG 

3 

4.3805 

Base  753 

PRWIO 

6 

10.9874 

(obs=153) 

PRWll 

5 

8.9576 

FOST 

4 

3.8938 

BJ-F 

1 

1.9743 

BJ-BR 

3 

2.3562 

BJ-WG 

2 

1.9960 

Base  754 

PRWIO 

3 

4.5656 

(obs=150) 

PRWll 

5 

8.5682 

FOST 

1 

2.7114 

BJ-F 

2 

2.8342 

BJ-BR 

6 

12.3076 

BJ-WG 

4 

7.2595 

Horizon 

PRWIO 

2 

4.3715 

5 

PRWll 

6 

10.5576 

(obs=88) 

FOST 

3 

5.0734 

BJ-F 

1 

2.3357 

BJ-BR 

5 

7.5704 

BJ-WG 

4 

5.4346 

Stratum 

Model 

Rank 

MSE 

Horizon 

PRWIO 

5 

14.1329 

1 

PRWll 

5 

14.1329 

(obs=93) 

FOST 

3 

4.5285 

BJ-F 

1 

2.6433 

BJ-BR 

2 

3.8651 

BJ-WG 

4 

5.1573 

Horizon 

PRWIO 

5 

5.4102 

2 

PRWll 

6 

5.4713 

(obs=93) 

FOST 

3 

4.8362 

BJ-F 

1 

3.0353 

BJ-BR 

2 

4.4001 

BJ-WG 

4 

5.1182 

Horizon 

PRWIO 

6 

6.7321 

3 

PRWll 

5 

5.5550 

(obs=93) 

FOST 

3 

1.5229 

BJ-F 

2 

1.3516 

BJ-BR 

4 

3.9066 

BJ-WG 

1 

2.1413 

Horizon 

PRWIO 

3 

3.2121 

4 

PRWll 

2 

2.7883 

(obs=91) 

FOSTl 

4 

3.8106 

BJ-F 

1 

2.4156 

BJ-BR 

6 

9.3347 

BJ-WG 

5 

4.8381 
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TABLE  5-54 

Mean  Absolute  Error  for  Industry  3560 
General  Industrial  Machinery  and  Equipment 


Stratum 

Model 

Rank 

MAbsE 

Industry 

PRWIO 

5 

1.0912 

3560 

PRWll 

6 

1.1462 

(obs=458) 

FOST 

3 

0.8711 

BJ-F 

1 

0.7941 

BJ-BR 

4 

0.9942 

BJ-WG 

2 

0.8442 

Stratum 

Model 
PRWIO 

Rank 

5 

MAbsE 

Stratum 
Horizon 

Model 

Rank 

MAbsE 

Base  752 

1.0286 

PRWIO 

5 

1.4805 

(obs=155) 

PRWll 

6 

1.1095 

1 

PRWll 

5 

1.4805 

FOST 

4 

0.8731 

(obs=93) 

FOST 

3 

0.8784 

BJ-F 

1 

0.7401 

BJ-F 

1 

0.7821 

BJ-BR 

3 

0.8427 

BJ-BR 

4 

0.8950 

BJ-WG 

2 

0.7845 

BJ-WG 

2 

0.8339 

Base  753 

PRWIO 

6 

1.2551 

Horizon 

PRWIO 

6 

1.0328 

(obs=153) 

PRWll 

5 

1.1184 

2 

PRWll 

5 

1.0200 

FOST 

4 

0.9710 

(obs=93) 

FOST 

3 

0.8295 

BJ-F 

2 

0.7409 

BJ-F 

2 

0.8198 

BJ-BR 

3 

0.8160 

BJ-BR 

4 

0.9328 

BJ-WG 

1 

0.6870 

BJ-WG 

1 

0.7920 

Base  754 

PRWIO 

3 

0.9888 

Horizon 

PRWIO 

5 

1.0276 

(obs=150) 

PRWll 

5 

1.2123 

3 

PRWll 

6 

1.0546 

FOST 

1 

0.7871 

(obs=93) 

FOST 

1 

0.6338 

BJ-F 

2 

0.9043 

BJ-F 

3 

0.6824 

BJ-BR 

6 

1.3324 

BJ-BR 

4 

0.8426 

BJ-WG 

4 

1.0662 

BJ-WG 

2 

0.6569 

Horizon 

PRWIO 

2 

0.9935 

Horizon 

PRWIO 

5 

0.9126 

5 

PRWll 

6 

1.3523 

4 

PRWll 

2 

0.8277 

(obs=88) 

FOST 

4 

1.1464 

(obs=91) 

FOSTl 

4 

0.8824 

BJ-F 

1 

0.9292 

BJ-F 

1 

0.7639 

BJ-BR 

5 

1.3068 

BJ-BR 

6 

1.0108 

BJ-WG 

3 

1.0699 

BJ-WG 

3 

0.8812 
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TABLE  5-55 

Mean  Absolute  Percent  Error  for  Industry  3560 
General  Industrial  Machinery  and  Equipment 


Stratum 

Model 

Rank 

MAbs%E 

Industry 

PRWIO 

5 

0.6870 

3560 

PRWll 

6 

0.7146 

(obs=458) 

FOST 

4 

0.6508 

BJ-F 

2 

0.5697 

BJ-BR 

3 

0.6069 

BJ-WG 

1 

0.5466 

Stratum 

Model 
PRWIO 

Rank 
6 

MAbs%E 

Base  752 

0.7456 

(obs=155) 

PRWll 

4 

0.6724 

FOST 

5 

0.6966 

BJ-F 

2 

0.5264 

BJ-BR 

3 

0.5605 

BJ-WG 

1 

0.5175 

Base  753 

PRWIO 

4 

0.6106 

(obs=153) 

PRWll 

6 

0.7048 

FOST 

5 

0.6229 

BJ-F 

1 

0.5158 

BJ-BR 

3 

0.5587 

BJ-WG 

2 

0.5202 

Base  754 

PRWIO 

5 

0.7045 

(obs=150) 

PRWll 

6 

0.7681 

FOST 

2 

0.6319 

BJ-F 

3 

0.6695 

BJ-BR 

4 

0.7040 

BJ-WG 

1 

0.6036 

Horizon 

PRWIO 

2 

0.6635 

5 

PRWll 

1 

0.6217 

(obs=88) 

FOST 

6 

0.9347 

BJ-F 

4 

0.7109 

BJ-BR 

5 

0.7377 

BJ-WG 

3 

0.6955 

Stratum   Model   Rank 


MAbs%E 


Horizon 

PRWIO 

5 

0.8284 

1 

PRWll 

5 

0.8284 

(obs=93) 

FOST 

4 

0.5597 

BJ-F 

2 

0.4568 

BJ-BR 

3 

0.4953 

BJ-WG 

1 

0.4551 

Horizon 

PRWIO 

6 

0.5590 

2 

PRWll 

5 

0.5515 

(obs=93) 

FOST 

4 

0.4925 

BJ-F 

2 

0.4602 

BJ-BR 

3 

0.4845 

BJ-WG 

1 

0.4419 

Horizon 

PRWIO 

5 

0.7793 

3 

PRWll 

6 

0.7860 

(obs=93) 

FOST 

2 

0.6421 

BJ-F 

3 

0.6475 

BJ-BR 

4 

0.6895 

BJ-WG 

1 

0.5692 

Horizon 

PRWIO 

3 

0.6017 

4 

PRWll 

6 

0.7818 

(obs=91) 

FOSTl 

5 

0.6400 

BJ-F 

2 

0.5810 

BJ-BR 

4 

0.6350 

BJ-WG 

1 

0.5801 
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TABLE  5-56 

Mean  Square  Error  for  Industries  3711  and  3713 
Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 


Stratum 

Model 
PRWIO 

Rank 
6 

MSE 

Industry 

28345.9 

3711/3713 

PRWU 

5 

23169.1 

(obs=189) 

FOST 

1 

4350.9 

BJ-F 

4 

15096.6 

BJ-BR 

3 

11858.3 

BJ-WG 

2 

11666.0 

Stratum 

Model 
PRWIO 

Rank 
6 

MSE 

Stratum 
Horizon 

Model 
PRWIO 

Rank 
5 

MSE 

Base  752 

32697.2 

32920.8 

(obs=65) 

PRWll 

4 

20189.3 

1 

PRWll 

5 

32920.8 

FOST 

2 

4070.2 

(obs=39) 

FOST 

1 

3209.9 

BJ-F 

3 

13638.1 

BJ-F 

4 

16212.4 

BJ-BR 

5 

20792.6 

BJ-BR 

3 

10962.6 

BJ-WG 

1 

4065.5 

BJ-WG 

2 

7224.1 

Base  753 

PRWIO 

6 

28950.1 

Horizon 

PRWIO 

6 

27283.5 

(obs=63) 

PRWll 

4 

22969.3 

2 

PRWll 

5 

17833.5 

FOST 

1 

4564.4 

(obs=39) 

FOST 

1 

2098.4 

BJ-F 

3 

16529.8 

BJ-F 

4 

17273.1 

BJ-BR 

2 

6839.8 

BJ-BR 

2 

6908.9 

BJ-WG 

5 

23544.5 

BJ-WG 

3 

14557.1 

Base  754 

PRWIO 

5 

23065.2 

Horizon 

PRWIO 

6 

23492.6 

(obs=61) 

PRWll 

6 

26550.7 

3 

PRWll 

5 

14944.1 

FOST 

1 

4429.7 

(obs=39) 

FOST 

1 

2154.5 

BJ-F 

4 

15170.4 

BJ-F 

4 

14015.4 

BJ-BR 

3 

7521.2 

BJ-BR 

2 

7854.1 

BJ-WG 

2 

7497.0 

BJ-WG 

3 

10893.6 

Horizon 

PRWIO 

6 

35300.7 

Horizon 

PRWIO 

6 

23180.2 

5 

PRWll 

5 

33045.6 

4 

PRWll 

5 

17841.5 

(obs=35) 

FOST 

1 

10558.6 

(obs=37) 

FOSTl 

2 

4370.9 

BJ-F 

3 

22186.3 

BJ-F 

3 

6059.5 

BJ-BR 

4 

30784.2 

BJ-BR 

1 

4337.5 

BJ-WG 

2 

16036.1 

BJ-WG 

4 

9981.1 
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TABLE 

5-57 

Mean 

Absolut 

e  Error  for  Industries  3711  and  3713 

Motor  Veh 

icles,  Car,  Truck,  and  Bus  Bodies 

Stratum 

Model 

Rank 

MAbsE 

Industry      PRWIO 

6 

77.2653 

3711/3713     PRWll 

5 

71.2643 

(obs=189)     FOST 

1 

33.8348 

BJ-F 

4 

52.3388 

BJ-BR 

3 

46.0128 

BJ-WG 

2 

45.1100 

Stratum 

Model 

Rank 

MAbsE 

Stratum 

Model 

Rank 

MAbsE 

Base  752 

PRWIO 

6 

83.5867 

Horizon 

PRWIO 

5 

92.3566 

(obs=65) 

PRWll 

5 

67.4966 

1 

PRWll 

5 

92.3566 

FOST 

2 

33.1506 

(obs=39) 

FOST 

1 

28.3122 

BJ-F 

3 

44.8356 

BJ-F 

4 

51.0455 

BJ-BR 

4 

57.6618 

BJ-BR 

3 

38.0479 

BJ-WG 

1 

31.0543 

BJ-WG 

2 

36.6049 

Base  753 

PRWIO 

6 

78.6085 

Horizon 

PRWIO 

6 

74.0031 

(obs=63) 

PRWll 

5 

70.5181 

2 

PRWll 

5 

65.4513 

FOST 

1 

33.9850 

(obs=39) 

FOST 

1 

25.2998 

BJ-F 

3 

52.9841 

BJ-F 

4 

56.1773 

BJ-BR 

2 

35.9683 

BJ-BR 

2 

38.1194 

BJ-WG 

4 

60.4735 

BJ-WG 

3 

49.1623 

Base  754 

PRWIO 

5 

69.1422 

Horizon 

PRWIO 

6 

61.3569 

(obs=61) 

PRWll 

6 

76.0496 

3 

PRWll 

5 

45.2462 

FOST 

1 

34.4090 

(obs=39) 

FOST 

1 

22.8556 

BJ-F 

4 

59.6675 

BJ-F 

4 

42.5952 

BJ-BR 

2 

43.9736 

BJ-BR 

3 

40.8060 

BJ-WG 

3 

44.2203 

BJ-WG 

2 

38.8427 

Horizon 

PRWIO 

5 

91.9097 

Horizon 

PRWIO 

6 

67.7123 

5 

PRWll 

6 

97.4967 

4 

PRWll 

5 

57.7590 

(obs=35) 

FOST 

2 

60.9370 

(obs=37) 

FOSTl 

2 

34.5879 

BJ-F 

3 

74.4133 

BJ-F 

3 

39.0451 

BJ-BR 

4 

82.4273 

BJ-BR 

1 

33.7702 

BJ-WG 

1 

58.7840 

BJ-WG 

4 

43.4748 

Stratum 


Model 


Rank 


MAbs%E 


Industry 

PRWIO 

5 

4.2922 

3711/3713 

PRWll 

6 

4.4777 

(obs=188) 

FOST 

4 

3.1998 

BJ-F 

1 

1.5843 

BJ-BR 

2 

1.6152 

BJ-WG 

3 

2.9833 
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TABLE  5-58 

Mean  Absolute  Percent  Error  for  Industries  3711  and  3713 
Motor  Vehicles,  Car,  Truck  and  Bus  Bodies 


Stratum 

Model 
PRWIO 

Rank 

5 

MAbs%E 
4.5865 

Stratum 
Horizon 

Model 

Rank 

MAbs%E 

Base  752 

PRWIO 

5 

5.4716 

(obs=64) 

PRWll 

4 

4.5638 

1 

PRWll 

5 

5.4716 

FOST 

6 

5.1466 

(obs=38) 

FOST 

4 

5.0999 

BJ-F 

1 

1.2108 

BJ-F 

1 

1.7096 

BJ-BR 

2 

1.7546 

BJ-BR 

2 

1.7566 

BJ-WG 

3 

2.6374 

BJ-WG 

3 

3.0394 

Base  753 

PRWIO 

6 

4.0243 

Horizon 

PRWIO 

5 

3.2875 

(obs=63) 

PRWll 

5 

3.8122 

2 

PRWll 

6 

3.3149 

FOST 

3 

2.3368 

(obs=39) 

FOST 

3 

2.4075 

BJ-F 

1 

0.8188 

BJ-F 

2 

1.2768 

BJ-BR 

2 

0.8810 

BJ-BR 

1 

1.1557 

BJ-WG 

4 

2.4733 

BJ-WG 

4 

2.4357 

Base  754 

PRWIO 

5 

4.2602 

Horizon 

PRWIO 

6 

3.4616 

(obs=61) 

PRWll 

6 

5.0747 

3 

PRWll 

5 

2.9952 

FOST 

1 

2.0485 

(obs=39) 

FOST 

1 

1.3377 

BJ-F 

3 

2.7669 

BJ-F 

2 

1.3648 

BJ-BR 

2 

2.2272 

BJ-BR 

3 

1.4138 

BJ-WG 

4 

3.8730 

BJ-WG 

4 

2.4166 

Horizon 

PRWIO 

4 

5.3893 

Horizon 

PRWIO 

6 

3.9776 

5 

PRWll 

6 

7.8202 

4 

PRWll 

5 

3.0835 

(obs=35) 

FOST 

5 

5.4912 

(obs=37) 

FOSTl 

3 

1.8786 

BJ-F 

1 

2.2856 

BJ-F 

2 

1.3479 

BJ-BR 

2 

2.6111 

BJ-BR 

1 

1.2243 

BJ-WG 

3 

4.3746 

BJ-WG 

4 

2.7842 

184 


PBWIO 


n  .-J" 


idl] 


PRWll 


r 


"L^^_ 


?OST 


|-^^_J   ^J 


J 


3J-F 


n    ,— r- 


^-,  r-n_.-n 


n 


3J-WG 


r-ijn_r 


n 


BJ-3R 


n 


!-J     n_ 


Distribution  of  Absolute  Percent  Error  for  Each  Quarterly  Model 

Industry  3531 
Figure  4 


Figure  5 

Distribution  of  Absolute  Percent  Error  for  Each  Quarterly  Model 

Industry  3550 


186 


n n 


Ul 


\j~i 


PRWIO 


L_r 


PRWll 


II 


FOST 


Osi 


BJ-F 


BJ-WG 


-n  ^ 


BJ-BR 


187 


^ 


"u — '-^  I    !    n 


PRWIO 


n 


r- 


PRWll 


L- 


^      n 


FCST 


3J-F 


r 


3J-WG 


-^U^   r^   _    n 


3J-3R 


Distribution  of  Absolute  Percent  Error  for  Each  Quarterly  Model 

Industry  3560 
Figure  6 


188 


Q 


P-^ 


r 


'-n 


PRWIO 


'-J 


n 


'  U        '-, 


PRWll 


Fes': 


p^' 


=J 


3J-F 


J      I 


d 


P  i  J  Lr 


3J-WG 


P 


n 


3J-3R 


Distribution  of  Absolute  Percent  Error  for  Each  Quarterly  Model 

Industries  3711  and  3713 

Figure  7 


CHAPTER  SIX 
SUMMARY  AND  CONCLUSIONS 


Summary 
Overview  of  the  Results 

The  primary  objective  of  this  project  has  been  to  develop  a 
particular  causal  modeling  approach.   Having  achieved  the  objective,  a 
single  major  conclusion  can  be  drawn  regarding  the  value  of  this  method 
which  incorporates  nonaccounting  information,  specifically 
macro-economic  factors,  in  earnings  prediction.   The  general  conclusion 
is  that  the  findings  support  acceptance  of  the  approach  as  a 
significant  contribution  to  the  prediction  literature.   Although  the 
specific  prediction  results  are  generally  mixed,  the  distributed  lag 
with  macros  (DLWM)  models  do  not  consistently  perform  worse  than  the 
comparison  models  which  lends  support  for  their  continued  use  and 
experimentation. 

The  results  of  both  annual  and  the  quarterly  analyses  suggest  that 
a  DLWM  model  appears  to  perform  as  well  as  literature-supported, 
univariate  models  in  describing  the  time-series  characteristics  of 
earnings  for  firms  in  the  four  industries  studied.   The  results, 
however,  are  dependent  on  the  nature  of  the  data  being  studied.   In 
particular,  the  DLWM  model  performs  better  in  the  annual  sample  using 
MSE,  especially  in  the  auto/truck  industry,  while  other  models  appear 
best  for  this  industry  in  the  quarterly  sample. 
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In  most  cases,  little  difference  in  predictive  accuracy  can  be 
found  at  significant  levels  and  certainly  none  of  a  systematic  nature. 
Those  differences  that  do  exist  appear  to  be  somewhat  data-set 
specific.   Intraindustry  differences  are  not  consistent  across  error 
measures. 

A  secondary  contribution  is  an  update  to  time-series  model 
prediction  performance.   The  work  presents  comparative  evidence  of  the 
predictability  of  numerous  well-known  models  using  fairly  recent 
prediction  periods.   Therefore,  evidence  is  supplied  as  to  the  current 
predictability  of  Box- Jenkins  (BJ)  and  non-BJ  time-series  models  as 
well  as  the  causal  models. 

The  study  resolves  few  of  the  inconsistencies  created  by  past 
research.   The  results  indicate  that  the  causal  modeling  approach  is  a 
more  accurate  predicter  of  annual  earnings  before  extraordinary  items 
in  some  industries  studied  and  is  at  least  as  accurate  in  predicting 
quarterly  earnings  in  the  same  context.   BJ  models  were  found  to  be  no 
more  accurate  than  a  distributed  lag  with  macros  model  in  all 
industries  at  all  prediction  horizons  tested  above  one  quarter.   One 
quarter  ahead  prediction  did  show  statistically  significant  superier 
performance  of  the  time-series  models,  but  not  always  those  estimated 
using  the  Box- Jenkins  procedure. 
Evaluation  of  the  Results 

Subjective  assessment  by  the  author  of  why  the  DLWM  models  do  not 
do  much  better  in  these  tests  rests  on  two  points.   Both  points  have  to 
do  with  a  model  specification  problem.   Selection  of  the  macros,  though 
derived  from  economic  theory,  remains  relatively  ad  hoc,  and  hence, 
specification  of  which  macros  to  select  can  be  improved  with 
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experimentation.   In  addition,  managers/auditors  of  individual 

companies  are  in  a  better  position  to  select  the  appropriate 

industry/economy  level  macros  which  affect  their  particular  firm. 

Related  to  this  first  problem  is  another  specification  issue. 
Prior  research  and  theory  have  been  incapable  of  specifying  the  precise 
nature  of  the  model  structure,  thus  requiring  considerable  judgment 
(within  the  DLWM  framework)  on  the  part  of  the  researcher. 
Consequently,  the  findings  reflect  the  combined  result  of  the  value  of 
the  approach  and  the  skill/guesswork,  of  the  researcher.   The  resulting 
sensitivity  is  an  important  factor  to  consider  in  the  evaluation  of  the 
DLWM  model  forecast  accuracy.   This  is  an  especially  acute  problem  in 
the  quarterly  analysis.   It  is  clear  that  the  "hot  and  cold" 
success/failure  pattern  of  the  approach  is  due  to  experiment  specific 
problems;  thus,  extensions  in  scope  will  prove  further  the  value  of  the 
approach. 

One  may  ask  if  the  industries  chosen  here  are  those  where  the  DLWM 
procedure  would  be  expected  to  do  relatively  well.   The  answer  is  "no"; 
the  counter  to  this  reasoning  involves  analysis  of  the  drug  industry 
(2830)  results.  As  the  first  annual  sample  shows,  the  DLWM  model  PRWIO 
outperforms  a  typical  random  walk  with  drift  (RWWD)  in  this  industry, 
except  for  three  individual  predictions.   Thus,  the  future  prospects 
for  success  across  industries  are  good,  even  in  industries  other  than 
where  favorable  results  are  expected  (i.e.,  capital/durable  goods). 

Some  of  the  key  questions  to  be  raised  when  evaluating  the 
performance  of  the  DLWM  approach  are: 

(1)  Is  forecast  superiority  maintained  at  long  forecast  horizons? 

(2)  Does  PRWIO  outperform  PRWll? 

(3)  Is  there  consistency  across  time,  error  measures,  and  data 
sets  (annual  versus  quarterly)? 
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For  the  first  question  the  following  is  noted.   If  within  a   particular 

industry  there  are  a  large  number  (or  high  percent)  of  prediction 

strata  which  result  in  a  significant  difference  between  two  models, 

then  one  might  reach  certain  conclusions  concerning  the  relative 

accuracy  of  these  models.   However,  if  there  is  no  significance  at 

longer  horizons,  then  doubt  in  such  a  conclusion  must  be  raised. 

Maintaining  superiority  is  necessary  before  a  model  is  singled  out,  for 

this  would  require  others  to  be  discarded — an  obviously  undesirable 

situation  if  the  superiority  is  only  short-lived. 

Logic  indicates  that  with  predicted  macros,  PRWll  should  be  less 
accurate  than  PRWIO.   The  causal  nature  of  the  DLWM  approach  dictates 
that  the  better  the  accuracy  with  regard  to  the  macros,  the  better  the 
prediction  of  the  earnings  variables.   To  maintain  that  a  series  of 
predictions  based  on  PRWll  is  more  accurate  than  PRWIO,  one  must 
believe  this  superiority  is  not  expected  to  continue  and  must  assume 
model  mlsspecif ication. 

The  annual  results  are  reasonably  strong  in  favor  of  the  approach, 
the  author  is  concerned  with  the  set  of  years /firms  used  in  this 
sample,  particularly  with  the  set  of  error  measures  available  for  use 
in  the  comparison  statistics.   The  results  of  the  quarterly  study  are 
somewhat  disappointing,  but  offer  motivation  to  continue  testing  the 
approach.   The  underlying  problems  with  the  current  quarterly  study  are 
the  formulation  of  lags/combination  of  lags  and  the  need  for  longer 
estimation  period. 
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Conclusions 
Value  of  the  Approach 

The  major  contribution  of  the  study  is  the  empirical  work  which 
demonstrates  the  predictability  of  a  distributed  lag  model 
incorporating  macro-ecomomic  explanatory  variables  in  an  ex  ante 
fashion.  The  following  section  indicates  the  numerous  ways  in  which 
the  approach  might  be  applied  to  increase  its  performance  relative  to 
other  time-series  methodologies. 
Extensions 

Many  extensions  to  the  current  research  are  possible.   Generally, 
future  projects  will  involve  capitalizing  on  the  results  given  here  and 
demonstrating  the  value  of  the  DLWM  approach  in  other  contexts.   The 
need  for  further  evidence  of  the  predictability  of  time-series  models 
of  earnings  motivates  continued  investigation  in  the  area. 

Extensions  related  directly  to  limitations  of  the  current  study. 
Extension  generally  can  be  sought  for  other  objects  of  prediction,  such 
as  earnings  per  share,  sales,  cash  flows,  etc.  Another  area  of 
investigation  involves  direct  comparison  of  causal  modeling  and  the 
predictions  of  either  security  analysts  and/or  corporate  management. 
Each  of  the  above  areas  of  research  can  be  broadened  by  looking  at  a 
wider  range  of  industrial  classifications  or  industry  groups. 

One  of  the  ramifications  of  the  current  work  is  the  confirmation 
that  individual  firms  and  specific  industries  vary  considerably  with 
regard  to  the  size  of  prediction  error  regardless  of  the  forecasting 
model  used.   Since  some  industries  are  harder  to  predict  than  others, 
the  aggregation  of  percent  errors  across  industries  distorts  the 
results  to  a  great  extent.   In  order  to  eliminate  this  phenomenon,  more 
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industries  and  more  firms  within  each  industry  need  to  be  studied. 

Although,  it  does  not  eliminate  directly  the  aggregation  problem,  this 

extension  allows  conclusions  to  be  drawn  on  larger,  homogeneous  subsets 

of  firms  and  on  more  types  of  firms. 

Related  to  the  problem  of  error  size  variation  across  industries 
is  the  disparity  of  firm  size  itself.   A  certain  dollar  size  prediction 
error  for  a  small  company  is  not  equivalent  to  the  same  size  error  for 
a  much  larger  company.   While  the  percent  error  measure  accounts  for 
this  to  some  degree  by  normalizing  on  an  income  variable ,  such  as 
earnings  itself,  other  techniques  also  are  possible.   One  method  would 
be  to  deflate  earnings  by  some  balance  sheet  measure  of 
size-of-the-f irm. 

A  straightforward  extension  of  any  series  of  predictions  would  be 
to  lengthen  the  forecast  horizons.   While  the  longest  horizon  in  the 
current  quarterly  study  is  only  five  periods  ahead,  other  time-series 
studies  have  investigated  as  many  as  twelve  to  fifteen.   Further 
verification  of  the  results  reported  here  would  consider  these 
additional  horizons. 

Establishing  longer  horizons  is  one  form  of  extension;  utilizing 
more  base  periods  also  is  important.   Because  two  annual  samples  are 
used  in  this  research,  the  dependency  of  prediction  results  on  the 
estimation  period  can  be  identified  easily.   Further  research  should 
consider  more  starting  points  for  each  set  of  predictions.   As  further 
evidence  is  gathered  using  a  DLWM  methodology,  the  need  for  comparing 
each  of  BJ  reidentification,  reestimation,  or  adaptive  forecasting 
techniques  to  the  causal  modeling  approach  will  become  evident. 


195 


Extension  related  to  further  model  specification.  Many  choices 
arise  with  the  current  application  of  the  DLWM  methodology.   Among  the 
many  crucial  decisions  to  be  made  is  the  selection  of  the 
macro-economic  variables.  A  natural  extension  of  this  research  would 
be  to  choose  other  economic  forces  or  combinations  of  forces, 
especially  since,  as  a  practical  matter,  economically  feasible 
variables  have  had  to  be  omitted. 

Another  possible  extension  involves  the  relationship  between  the 
DLWM  parameter  estimation  technique  and  the  model's  general  poor 
performance  based  on  mean  absolute  percent  error  (MAbs%E).   The 
extension  would  be  the  estimation  of  parameters,  not  by  ordinary  least 
squares  (OLS),  but  by  least  absolute  value  criterion  (LAV).   This 
approach  should  perform  better  than  OLS  since  the  minimization  of 
regression  line  errors  for  the  sample  period  would  be  consistent  with 
the  error  measure  used  to  evaluate  the  model  in  the  post-estimation 
period. 
Specific  Conclusions 

The  first  portion  discusses  the  conclusions  which  can  be  reached 
on  the  basis  of  the  empirical  work  done  in  the  previous  chapter.   The 
discussion  centers  primarily  on  the  value  of  the  causal  modeling 
approach,  the  strength  of  the  model,  and  its  use  in  future  forecast 
evaluation.   Although  not  compelling,  the  findings  of  this  research 
lead  to  the  conclusion  that  a  causal  modeling  approach  to  earnings 
prediction,  such  as  the  DLWM  model,  should  continue  to  be  among  the  set 
of  models  used  to  characterize  the  earnings  time-series 
state-of-the-art.   Further  studies  which  attempt  to  establish  a  premier 
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model  or  which  attempt  to  evaluate  management /analysts'  forecasts, 

should  include  this  model  type  in  the  analysis. 

The  results  of  Chapter  Five  lead  to  two  basic  findings.   First, 
the  well-known  time-series  models  do  not  perform  consistently  at  levels 
sufficient  to  resolve  anjr  premier  model  discussions.   Second,  the 
research  presented  here  indicates  the  viability  of  another  method  for 
predicting  both  annual  and  quarterly  earning  before  extraordinary 
items. 
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APPENDIX  A 
LIST  OF  FIRMS  IN  ANNUAL  SAMPLE  #  1 


Industry  2830 

1  ABBOTT  LABORATORIES  2824 

3  AMERICAN  HOME  PRODUCTS  CORP   26609 

5  FOREST  LABORATORIES  INC  345838 

7  LILLY  (ELI)&  CO  532457 

9  MERCK  &  CO  589331 

10  PFIZER  INC  717081 

11  PUREPAC  LABORATORIES  746231 

12  RICHARDSON-MERRELL  INC  763172 

13  ROBINS  (A.H.)  CO  770706 

14  RORER  GROUP  776755 

15  SCHERING-PLOUGH  806605 

16  SEARLE  (G.D.)  &  CO  812302 

18  SMITHKLINE  CORP  832377 

19  SQUIBB  CORP  852245 

20  STERLING  DRUG  INC  859264 

21  SYNTEX  CORP  871616 

22  TAMPAX  INC  875314 

23  UPJOHN  CO  915302 

24  WARNER-LAMBERT  CO  934488 


Industry  3531 

25  AMERICAN  HOIST  &  DERRICK 

26  BUCYRUS-ERIE  CO 

28  CATERPILLAR  TRACTOR  CO 

29  CLARK  EQUIPMENT  CO 

31  FMC  CORP 

32  KOEHRING  CO 

33  PORTEC  INC 

34  REXNORD  INC 

35  UNARCO  INDUSTRIES  INC 


CO 


26573 
118745 
149123 
181396 
302491 
500170 
736202 
761688 
904274 


211 


212 


Industry  3550 

36  BETHLEHEM   CORP 

37  BLACK  &   DECKER  MFC   CO 

38  COMPO   INDS 

39  CORDON  INTL 

40  DOVER  CORP 

41  EMHART   CORP 

42  EX-CELL-0   CORP 

43  IONICS    INC 

44  JOY  MFC   CO 

45  LEESONA   CX)RP 

46  LODGE  &   SHIPLEY   CO 

47  MCNEIL   CORP 

48  MIDLAND-ROSS    CORP 

49  NEWCOR   INC 

50  OMARK  INDUSTRIES  INC 

51  PNEUMATIC  SCALE  CORP 

53  SELAS  CORP  OF  AMERICA 

54  STERLING  EXTRUDER  CORP 

55  STRUTHERS  WELLS  CORP 
57  WOOD  INDUSTRIES  INC 


87257 
91797 
204525 
218534 
260003 
291210 
300587 
462218 
481196 
524462 
540210 
582562 
597715 
651186 
682063 
730162 
816119 
859298 
863659 
978403 


Industries  3711  and  3713 


111  AMERICAN  MOTORS  CORP  27627 

112  CHECKER  MOTORS  CORP  162789 

113  CHRYSLER  CORP  171196 

114  FORD  MOTOR  CO  OF  CANADA  LTD   345352 

115  FORD  MOTOR  CO  345370 

116  GENERAL  MOTORS  CORP  370442 

117  ALTAMIL  CORP  21375 

118  CCI  CORP  124884 

119  CONDEC  CORP  206741 

120  CUMMINS  ENGINE  231021 

121  INTL  HARVESTER  CO  459578 

122  NOVO  CORP  670096 
124  WHITE  MOTOR  CORP  964066 


Industry  3560 
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58  A-T-0  INC  2080 

59  AERO-FLOW  DYNAMICS  INC  7680 

60  ANSUL  CO  36627 

61  ARO  CORP  42627 

62  B  T  U  ENGINEERING  56029 

63  BARNES  GROUP  INC  67806 

65  BRIGGS  &  STRATTON  109043 

66  CHICAGO  PNEUMATIC  TOOL  CO    167898 

67  COOPER  INDS  INC  216669 

68  CURTISS-WRIGHT  CORP  231561 

69  DORR-OLIVER  INC  258363 

70  DYMO  INDS  INC  267741 

71  DYNAMICS  CORP  OF  AMERICA  268039 

72  GARDNER-DENVER  CO  365550 

74  GREER  HYDRAULICS  INC  397442 

75  HOBART  CORP  433728 

76  IMC  MAGNETICS  CORP  449680 

77  INGERSOLL-RAND  CO  456866 

78  KEENE  CORP  487314 

79  LFE  CORP  501858 
81  MESTA  MACHINE  CO  590825 

84  NEW  HAMPSHIRE  BALL  BEARINGS   644596 

85  PALL  CORP  696429 

86  PARKER-HANNIFIN  CORP  701094 

89  RILEY  CO  766626 

90  SALEM  CORP  794099 

91  STEWART-WARNER  CORP  860486 

92  TELEFLEX  INC  879369 

93  TENNEY  ENGINEERING  INC  880625 

94  TORIN  CORP  891067 


APPENDIX  B 
LIST  OF  FIRMS  IN  ANNUAL  SAMPLE  //2 


Industry  3531 

25  AMERICAN  HOIST  &  DERRICK 

26  BUCYRUS-ERIE  CO 

28  CATERPILLAR  TRACTOR  CO 

29  CLARK  EQUIPMENT  CO 

31  FMC  CORP 

32  KOEHRING  CO 

33  PORTEC  INC 

34  REXNORD  INC 

35  UNARCO  INDUSTRIES  INC 


CO 


26573 
118745 
149123 
181396 
302491 
500170 
736202 
761688 
904274 


Industries  3550  and  3560 

39  CORDON  INTL  218534 

44  JOY  MFC  CO  481196 

49  NEWCOR  INC  651186 

54  STERLING  EXTRUDER  CORP  859298 

59  AERO-FLOW  DYNAMICS  INC  7680 

65  BRIGGS  &  STRATTON  109043 

70  DYMO  INDS  INC  267741 

75  HOBART  CORP  433728 

81  MESTA  MACHINE  CO  590825 

86  PARKER-HANNIFIN  CORP  701094 


Industries  3711  and  3713 

111  AMERICAN  MOTORS  CORP  27627 

112  CHECKER  MOTORS  CORP  162789 

113  CHRYSLER  CORP  171196 

114  FORD  MOTOR  CO  OF  CANADA  LTD   345352 

115  FORD  MOTOR  CO  345370 

116  GENERAL  MOTORS  CORP  370442 

117  ALTAMIL  CORP  21375 

118  CCI  CORP  124884 

119  CONDEC  CORP  206741 

120  CUMMINS  ENGINE  231021 

121  INTL  HARVESTER  CO  459578 

122  NOVO  CORP  670096 
124  WHITE  MOTOR  CORP  964066 
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APPENDIX  C 
LIST  OF  FIRMS  IN  QUARTERLY  SAMPLE 


Industry  3531 

25  AMERICAN  HOIST  &  DERRICK 

27  CMI  CORP 

28  CATERPILLAR  TRACTOR  CO 

29  CLARK  EQUIPMENT  CO 

31  FMC  CORP 

32  KOEHRING  CO 

33  PORTEC  INC 

34  REXNORD  INC 

35  UNARCO  INDUSTRIES  INC 


CO 


26573 
125761 
149123 
181396 
302491 
500170 
736202 
761688 
904274 


Industry  3550 

36  BETHLEHEM  CORP  87257 

37  BLACK  &  DECKER  MFC  CO  91797 

38  COMPO  INDS  204525 

40  DOVER  CORP  260003 

41  EMHART  CORP  291210 

42  EX-CELL-0  CORP  300587 

44  JOY  MFC  CO  481196 

45  LEESONA  CORP  524462 

46  LODGE  &  SHIPLEY  CO  540210 

47  MCNEIL  CORP  582562 

48  MIDLAND-ROSS  CORP  597715 

49  NEWCOR  INC  651186 

50  OMARK  INDUSTRIES  INC  682063 

52  ROCKAWAY  CORP  772786 

53  SELAS  CORP  OF  AMERICA  816119 

54  STERLING  EXTRUDER  CORP  859298 

55  STRUTHERS  WELLS  CORP  863659 
57  WOOD  INDUSTRIES  INC  978403 
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Industry  3560 

58  A-T-0  INC  2080 

59  AERO-FLOW  DYNAMICS  INC  7680 

60  ANSUL  CO  36627 

61  ARO  CORP  42627 

62  B  T  U  ENGINEERING  56029 

63  BARNES  GROUP  INC  67806 

65  BRIGGS  &  STRATTON  109043 

66  CHICAGO  PNEUMATIC  TOOL  CO    167898 

68  CURTISS-WRIGHT  CORP  231561 

69  DORR-OLIVER  INC  258363 

70  DYMO  INDS  INC  267741 

71  DYNAMICS  CORP  OF  AMERICA  268039 

72  GARDNER-DENVER  CO  365550 

73  GORMAN-RUPP  CO  383082 

74  GREER  HYDRAULICS  INC  397442 

75  HOBART  CORP  433728 

76  IMC  MAGNETICS  CORP  449680 

77  INGERSOLL-RAND  CO  456866 

78  KEENE  CORP  487314 

79  LFE  CORP  501858 
82  MILTON  ROY  CO  602108 
84  NEW  HAMPSHIRE  BALL  BEARINGS  644596 
86  PARKER-HANNIFIN  CORP  701094 

88  RANSBURG  CORP  753228 

89  RILEY  CO  766626 

90  SALEM  CORP  794099 

91  STEWART-WARNER  CORP  860486 

92  TELEFLEX  INC  879369 

93  TENNEY  ENGINEERING  INC  880625 

94  TORIN  CORP  891067 


Industries  3711  AND  3713 


111  AMERICAN  MOTORS  CORP  27627 

112  CHECKER  MOTORS  CORP  162789 

113  CHRYSLER  CORP  171196 

114  FORD  MOTOR  CO  OF  CANADA  LTD   345352 

115  FORD  MOTOR  CO  345370 

116  GENERAL  MOTORS  CORP  370442 

118  CCI  CORP  124884 

119  CONDEC  CORP  206741 

120  CUMMINS  ENGINE  231021 

121  INTL  HARVESTER  CO  459578 

122  NOVO  CORP  670096 

123  SARGENT  INDUSTRIES  803667 

124  WHITE  MOTOR  CORP  964066 


APPENDIX  D 
ANNUAL  HYPOTHESES 
Al :  PRWIO  is  at  least  as  accurate  as  ALU 
A2:   PRWll  is  at  least  as  accurate  as  ALM 
A3:   PRW30  is  at  least  as  accurate  and  ALM 
A4:   PRWIO  is  at  least  as  accurate  as  PRWll 
A5:   PRWIO  is  at  least  as  accurate  as  PRW30 
A6:   PRW41  is  at  least  as  accurate  as  ALM 
A7:   PRW41  is  at  least  as  accurate  as  PRW42 
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APPENDIX  E 
QUARTERLY  HYPOTHESES 
Ql:  PRWU  is  at  least  as  accurate  as  FOST. 
Q2:   PRWll  is  at  least  as  accurate  as  BJ-F. 
Q3:   PRWll  is  at  least  as  accurate  as  BJ-BR. 
Q4:  PRWll  is  at  least  as  accurate  as  BJ-WG. 
Q5:   PRWIO  is  at  least  as  accurate  as  FOST. 
Q6:   PRWIO  is  at  least  as  accurate  as  BJ-F. 
Q7:   PRWIO  is  at  least  as  accurate  as  BJ-BR. 
Q8:   PRWIO  is  at  least  as  accurate  as  BJ-WG. 
Q9:   PRWIO  is  at  least  as  accurate  as  PRWll. 
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APPENDIX  F 
SAMPLE  #2  RESULTS  WITH  STANDARD  DEVIATIONS 


Summary  of  Sample  #2  Mean  Square  Error  Data 
by  Base  Period  and  by  Forecast  Horizon 


Stratum 


Base  75 


Model 

PRWIO 
PRWll 
PRW30 
ALM 


Rank 

1 
2 
4 
3 


MSE 

77227.2 
101971.2 
188070.3 
184907.9 


Std.Dev.  of  MSE 

283122.7 
443352.8 
885807.9 
752415.6 


Base  76 


PRWIO 
PRWll 
PRW30 
ALM 


32468.7 

43977.3 

2298984.3 

23626.5 


161755.1 

226548.2 

15567908.3 

78392.7 


Base  77 


PRWIO 
PRWll 
PRW30 
ALM 


23935.1 

23935.1 

441754.9 

5989.0 


118189.5 

118189.5 

1750869.5 

22901.0 


Horizon  1 


PRWIO 
PRWll 
PRW30 
ALM 


24053.8 

24583.8 

258379.9 

48097.1 


99719.2 

99719.2 

1182764.0 

287844.2 


Horizon  2 


PRWIO 
PRWll 
PRW30 
ALM 


61755.7 

76749.3 

2263124.5 

126511.8 


237717.3 

302141.7 

15565027.5 

604219.5 


Horizon  3 


PRWIO 
PRWll 
PRW30 
ALM 


139908.2 
215333.0 
282155.1 
246137.0 


427634.0 

739898.0 

1231296.2 

949563.1 
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Summary  of  Sample  #2  Mean  Absolute  Error  Data 
by  Base  Period  and  by  Forecast  Horizon 


Stratum 

Model 

Rank 

MAbsE 

Std.Dev.  of  MAbsE 

Base  75 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
3 

4 

104.7844 
114.0055 
126.7705 
132.1378 

258.8780 
300.0142 
417.1326 
411.5758 

Base  76 

PRWIO 
PRWll 
PRW30 
ALM 

1 
3 
4 
2 

60.0229 

69.5528 

318.8610 

60.0576 

171.4658 

199.6611 

1495.9650 

142.7948 

Base  77 

PRWIO 
PRWll 
PRW30 
ALM 

2 
2 
3 

1 

45.1662 

45.1662 

193.7347 

28.9923 

150.9004 

150.9004 

648.3754 

73.1738 

Horizon  1 

PRWIO 
PRWll 
PRW30 
ALM 

1 
1 
3 
2 

55.0930 

55.0930 

139.8035 

62.3237 

145.8184 
145.8184 
491.5405 
211.4875 

Horizon  2 

PRWIO 
PRWll 
PRW30 
ALM 

1 
2 
4 
3 

90.4998 
100.3643 
316.0302 
110.6846 

233.5754 

260.5977 

1484.3550 

341.1403 

Horizon  3 

PRWIO 
PRWll 
PRW30 
ALM 

1 
4 
3 
2 

146.9708 
177.1183 
156.1126 
155.5054 

350.7708 
437.4022 
517.7793 
480.4512 
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Sunmary  of  Sample  #2  Mean  Absolute  Percent  Error  Data 
by  Base  Period  and  by  Forecast  Horizon 


Stratum 

Model 

Rank 

MAbs%E 

Std.Dev.  of  MAbs%E 

Base  75 

PRWIO 
PRWll 
PRW30 
ALM 

2 
4 
1 
3 

3.8979 
5.5938 
3.7770 
4.0836 

25.1875 
41.7923 
21.9965 
25.6299 

Base  76 

PRWIO 
PRWll 
PRW30 

ALM 

4 
3 

2 
1 

7.5601 
5.0036 
2.8879 
1.3530 

38.0487 

21.4133 

12.6532 

3.9918 

Base  77 

PRWIO 
PRWll 
PRW30 
ALM 

3 
3 
2 
1 

9.8745 
9.8745 
5.0400 
0.5275 

47.2423 

47.2423 

22.5804 

1.6706 

Horizon  1 

PRWIO 
PRWll 
PRW30 
ALM 

3 
3 

2 
1 

4.8977 
4.8977 
2.2063 
0.7801 

27.8747 

27.8747 

12.6394 

2.3886 

Horizon  2 

PRWIO 
PRWll 
PRW30 
ALM 

4 
2 
3 

1 

5.9955 
3.2138 
3.7143 
2.3794 

35.8354 

16.8396 

13.9023 

9.1673 

Horizon  3 

PRWIO 
PRWll 
PRW30 
ALM 

3 

4 
1 
2 

9.8388 

15.9897 

8.5476 

9.4103 

45.9494 
76.4097 
39.0416 
45.2929 

APPENDIX  G 
PROGRAM  TO  PRODUCE  ANNUAL  PREDICTIONS  (SAMPLE  #2) 


//   EXEC   SAS 

//HOPE  DD   DSN=UF.G0002263.S01.ANNUAL3,DISP=OLD 

*AA4; 

DATA  DEAD; 

INPUT   BASE; 

CARDS; 
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OPTIONS   NODATE; 

MACRO  PROGRAM 

DATA  SYSTOl; 
SET   HOPE. ANNUAL; 
EZ=EARN; 
EZ1=LAG(EZ); 
EZ2=LAG2(EZ); 
IF  YEAR  LE   76   THEN  E=EZ; 
E1=LAG(E); 
E2=LAG2(E); 
EZ1=LAG(EZ); 
EZ2=LAG2(EZ); 
S1=LAG(ST0CKM2); 
S2=LAG2(ST0CKM2); 
R1=LAG(RINT); 
R2=LAG2(RINT); 
V1=LAG(GPDI); 
V2=LAG2(GPDI); 
S=T*T; 
U=T*T*T; 
FIRM=COMP; 
INUM=3550; 

KEEP   YEAR  EZ   T  VI    V2    SI    S2   Rl    R2   E   EZl    EZ2   El    E2    S 
FIRM    INUM  U    ; 

DATA  FYEAR; 

SET   SYSTEM; 

RETAIN   FIRST   FYR; 

IF    FIRST   EQ    .    AND    EZ   NE    .    THEN  DO; 

FIRST=EZ; 

FYR=YEAR; 

END; 

DATA  TREND; 

SET   FYEAR; 

IF  YEAR  GE   76; 

KEEP   YEAR  EZ      FIRST   FYR; 
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*  MODEL  PRW30  BELOW; 

PROG  AUTOREG  DATA=SYSTEM  NOPRINT; 

TITLE  NEW  ANNUAL  PROGRAM; 

MODEL  El=  U  S  T; 

OUTPUT  OUT=YYHAT  P=EHAT1; 

PROG  AUTOREG  NOPRINT  DATA=YYHAT; 

MODEL  E=S  T  EHATl; 

OUTPUT  OUT=BETAS  PARMS=B4  35  GMHAT  INTERCEPT=BO; 

DATA  RES; 

SET  BETAS; 

ZHAT-E  -BO  -B4*S  -B5*T  -GMHAT*E1; 

ZHAT1=LAG(ZHAT); 

IF  YEAR  GE  76  THEN  DO; 

ZBAR=EZ  -BO  -B4*S  -B5*T  -GMHAT*EZ1; 

ZBAR1=LAG(ZBAR); 

END; 

PROG  AUTOREG  NOPRINT  DATA=RES; 

MODEL  ZHAT=ZHAT1; 

OUTPUT  0UT=P1  PARMS=PHAT; 

DATA  TRANS; 

SET  PI; 

ESTAR=E  -PHAT*E1; 

0NESTAR=1  -PHAT; 

SSTAR=S  -PHAT*LAG(S); 

TSTAR=T  -PHAT*(T-1); 

E1STAR=E1  -PHAT*E2; 

EZ1STAR=»EZ1  -PHAT*EZ2; 

EZSTAR=EZ  -PHAT*EZ1; 

PROG  AUTOREG  NOPRINT  DATA=TRANS; 

MODEL  ESTAR=ONESTAR  SSTAR  TSTAR  EISTAR  ZHATl/NOINT; 

OUTPUT  OUT=PREDICT  PARMS=CO  C4  C5  GM  DELTA  R=Z; 

DATA  Y678; 

SET  PREDICT; 

IF  YEAR  GE  76; 

P=DELTA+PHAT; 

Z1=LAG(Z); 

Z2=LAG2(Z); 

ZB=-(ONESTAR*CO  +SSTAR*C4  +TSTAR*C5  +EZ1STAR*GM 

+ZBAR1*DELTA  -EZSTAR) ; 
ZB1=LAG(ZB); 

*END  OF  PRW30; 

*  MODEL  PRWIQ  BELOW; 

PROG  AUTOREG  DATA=SYSTEM  NOPRINT; 

TITLE  NEW  ANNUAL  PROGRAM; 

MODEL  E1=V1  V2  SI  S2  Rl  R2  S  T; 

OUTPUT  OUT=YHAT  P=EHAT1; 

PROG  AUTOREG  NOPRINT  DATA=YHAT; 

MODEL  E=V1  SI  Rl  S  T  EHATl; 

OUTPUT  OUT=BETA  PARMS=C1  C2  C3  C4  C5  GMHAT  INTERCEPT=GO; 

DATA  RRES; 
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SET  BETA; 

ZHAT=E  -CO  -C1*V1  -C2*S1  -C3*R1  -C4*S  -C5*T  -GMHAT*E1; 

ZHAT1=LAG(ZHAT); 

IF  YEAR  GE  76  THEN  DO; 

ZBAR=EZ  -CO  -C1*V1  -C2*S1  -C3*R1  -C4*S 

-C5*T  -GMHAT*EZ1; 
ZBAR1=LAG(ZBAR); 
END; 

PROC  AUTOREG  NOPRINT  DATA=RRES; 
MODEL  ZHAT=ZHAT1; 
OUTPUT  0UT=P2  PARMS=PHAT; 
DATA  TRAN; 
SET  P2; 

ESTAR=E  -PHAT*E1; 
0NESTAR=1  -PHAT; 
V1STAR=V1  -PHAT*LAG(V1); 
S1STAR=S1  -PHAT*LAG(S1); 
R1STAR=R1  -PHAT*LAG(R1); 
SSTAR=S  -PHAT*LAG(S); 
TSTAR=T  -PHAT*(T-1); 
E1STAR=E1  -PHAT*E2; 
EZ1STAR=EZ1  -PHAT*EZ2; 
EZSTAR=EZ  -PHAT*EZ1; 
PROC  AUTOREG  NOPRINT  DATA=TRAN; 
MODEL  ESTAR=ONESTAR  VI STAR  SI STAR  RISTAR  SSTAR  TSTAR 

EISTAR  ZHATl/NOINT; 
OUTPUT  OUT=PRED  PARMS=BO  Bl  B2  B3  B4  B5  GMM  DELTA  R=Z; 
DATA  Z678; 
SET  PRED; 
IF  YEAR  GE  76; 
PP=DELTA+PHAT; 
ZZ1=LAG(Z); 
ZZ2=LAG2(Z); 
ZZB=-(ONESTAR*B0  +V1STAR*B1  +S1STAR*B2  +R1STAR*B3 

+SSTAR*B4  +TSTAR*B5  +EZ1STAR*GMM  +ZBAR1*DELTA  -EZSTAR) ; 
ZZBI=LAG(ZZB); 

*END  OF  PRWIO; 

DATA  F678; 

MERGE  Y678  Z678; 

RETAIN  DIO  D30; 

IF  YEAR  LE  77  THEN  DO; 

PRW10=B0  +B1*V1  +B2*S1  +B3*R1  +B4*S  +B5*T 

+GMM*E1  +PP*ZZ1; 
PRW11=PRW10; 

PRW30=C0  +C4*S  +C5*T  +GM*E1  +P*Z1; 
D30=PRW30; 
D10=PRW10; 
H0RIZ0N=1; 
BASE=76; 

ORDER=FIRM*1000+HORIZON*100+BASE; 
END; 

IF  YEAR=78  THEN  DO; 
PRW10=B0  +B1*V1  +B2*S1  +B3*R1  +B4*S  +B5*T 
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+GMM*D10  +PP*ZZ2; 
PRW11=B0  +B1*(1906)  +B2*(5141)  +B3*(190)  +B4*S  +B5*T 

+GMM*D10  +PP*ZZ2; 
PRW30=C0  +04*8  +C5*T  +GM*D30  +P*P*Z2; 
H0RIZ0N=2; 
BASE=76; 

ORDER=FIRM* 1000+HORIZON* 100+BASE ; 
END; 

DATA  FF678; 

SET  TREND; 

RETAIN  FFOLD; 

IF  YEAR  LE  77  THEN  DO; 

ALM=LAG(EZ)  +(LAG(EZ)  -FIRST) / (YEAR-FYR-2 ) ; 

FFOLD=ALM; 

END; 

IF  YEAR  =78  THEN 

ALM=FFOLD  +(FFOLD  -FIRST) / (YEAR-FYR-2 ) ; 

DATA  B76; 

MERGE  F678  FF678; 

IF  YEAR  GE  77; 

ACTUAL=EZ; 

KEEP  PRWIO  PRWll  PRW30  ALM  HORIZON  BASE  ORDER  INUM  FIRM  ACTUAL; 

DATA  F78; 

SET  F678; 

PRW10=B0  +B1*V1  +B2*S1  +B3*R1  +B4*S  +B5*T  +GMM*EZ1  +PP*ZZB1; 

PRWll -PRWIO; 

PRW30=C0  -l-C4*S  +C5*T  +GM*EZ1  +P*ZB1; 

HORIZON- 1; 

BASE-77; 

ORDER=FIRM*1000+HORIZON*100+BASE; 

DATA  FF78; 
SET  TREND; 
ALM=LAG(EZ)   +(LAG(EZ)    -FIRST) / (YEAR-FYR-2 ) ; 

DATA  B77; 

MERGE  F78  FF78; 

IF  YEAR  EQ  78; 

ACTUAL-EZ; 

KEEP  PRWIO  PRWll  PRW30  ALM  HORIZON  BASE  ORDER  INUM  FIRM  ACTUAL; 

DATA  DEAD; 

SET  DEAD  B76  B77; 


MACRO 

COMP 

39 

7, 

MACRO 

EARN 

ER39 

% 

PROGRAM; 

MACRO 

COMP 

44 

% 

MACRO 

EARN 

ER44 

% 

PROGRAM; 

MACRO 

COMP 

49 

% 

MACRO 

EARN 

ER49 

% 

PROGRAM; 

MACRO 

COMP 

54 

% 

MACRO 

EARN 

ER54 

% 

PROGRAM; 

MACRO 

COMP 

59 

7o 

MACRO 

EARN 

ER59 

% 

PROGRAM; 

MCRO 

COMP 

65 

Z 

MACRO 

EARN 

ER65 

% 

PROGRAM; 

MACRO 

COMP 

70 

% 

MACRO 

EARN 

ER70 

% 

PROGRAM; 

MACRO 

COMP 

75 

X 

MACRO 

EARN 

ER75 

% 

PROGRAM; 

MACRO 

COMP 

81 

% 

MACRO 

EARN 

ER81 

% 

PROGRAM; 
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MACRO  COMP  86  %  MACRO  EARN  ER86  %  PROGRAM; 

DATA  GOOD; 

SET  DEAD; 

IF  BASE  NE  222; 

DATA  HOPE.FINALA; 

SET  HOPE.FINALA  GOOD; 

PROC  PRINT  DATA=HOPE.FINALA; 

TITLE  PREDICTIONS  WITH  BASE  EQUAL  TO  1976  AND  1977; 

/*EOJ 


APPENDIX  H 
PROGRAM  TO  PRODUCE  QUARTERLY  NON  B-J  PREDICTIONS 


//  EXEC  SAS 

//FTllFOOl  DD  DUMMY 

//QTRS  DD  DSN=UF.G0002263.S01.QARTER2,DISP=OLD 

DATA  DEAD; 

INPUT  YQ; 

CARDS; 
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OPTIONS  NOD ATE; 

MACRO  PROGRAM 

DATA  COMPANY; 

SET  QTRS. FIRMS; 

IF  CNUM=COMNUM; 

FIRM=COMP; 

IF  E  GT  0  AND  E  LT  .0004  THEN  ACTUAL=.; 

IF  E  LE  0  OR  E  GE  .0004  THEN  ACTUAL=E; 

YQ=10*YEAR+QTR; 

KEEP  YQ  YEAR  QTR  ACTUAL  CNUM  DNUM  FIRM  E; 

DATA  SYSTEM; 

MERGE  COMPANY  QTRS.QMACRO; 

BY  YQ; 

LAST=752; 

IF  YQ  LE  LAST  THEN  EY=ACTUAL; 

IF  QTR=1  THEN  DO; 

Dl-1; 

D2=0; 

D3=0; 

END; 

IF  QTR=2  THEN  DO; 

D1=0; 

D2=l; 

D3=0; 

END; 

IF  QTR=3  THEN  DO; 

D1=0; 

D2=0; 

D3=l; 

END; 

IF  QTR=4  THEN  DO; 

D1=0; 

D2=0; 

D3=0; 

END; 

RETAIN  Fl  F2  F3  F4; 
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IF  YQ=681  THEN  DO; 

F1=EY; 

FZ1=ACTUAL; 

END; 

IF  YQ=682  THEN  DO; 

F2=EY; 

FZ2=ACTUAL; 

END; 

IF  YQ=683  THEN  DO; 

F3=EY; 

FZ3=ACTUAL; 

END; 

IF  YQ=684  THEN  DO; 

F4=EY; 

END; 

IF  QTR=1  THEN  DO; 

FIR=F1; 

END; 

IF  QTR=2  THEN  DO; 

FIR='F2; 

END; 

IF  QTR=3  THEN  DO; 

FIR=F3; 

END; 

IF  QTR=4  THEN  DO; 

FIR=>F4; 

END; 

IF  YEAR=70  THEN 

IF  YEAR=71  THEN 

IF  YEAR=72  THEN  A=3 

IF  YEAR=73  THEN  A=4 

IF  YEAR=74  THEN  A=5 

IF  YEAR=75  THEN 

IF  YEAR=76  THEN 

IF  YEAR='77  THEN  A=8 

E1=LAG1(EY) 

E4=«LAG4(EY) 

E5=LAG5(EY) 

DEL=(E4-FIR)/A; 

REG=E1-E5; 

FHAT=E-E4-DEL; 

T2=LAG2(GPDI); 

T1=«LAG1(MS); 

EZ5=LAG5( ACTUAL); 

EZ1=LAG1 (ACTUAL); 

EZ4=LAG4(ACTUAL); 

M1=LAG1(GPDI)+LAG2(GPDI)+LAG3(GPDI)+LAG4(GPDI); 

M2=LAG1(MS   )+LAG2(MS   )+LAG3(MS   )+LAG4(MS   ); 

M158=  LAG5(GPDI)+  LAG6(GPDI)+  LAG7(GPDI)+  LAG8(GPDI) 

M258=  LAG5(MS   )+  LAG6(MS   )+  LAG7(MS   )+  LAG8(MS   ) 

M1912=LAG9(GPDI)+LAG10(GPDI)+LAG11(GPDI)+LAG12(GPDI) 

M2912=LAG9(MS   )+LAG10(MS   )+LAGll(MS   )+LAG12(MS   ) 


A=l 
A=2 


A=6 
A=7 


PROC  AUTOREG  NOPRINT  DATA=SYSTEM; 

MODEL  E1=T   Dl  D2  D3  Ml  M2  Ml 58  M258  T2  Tl ; 
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OUTPUT  OUT=EHATA  P=E1HAT; 

TITLE  QUARTERLY  PROGRAM  ALL  BASE  YEARS; 

PROC  AUTOREG  NOPRINT  DATA=EHATA; 

MODEL  E4=T   Dl  D2  D3  M158  M258  M1912  M2912  T2  Tl; 

OUTPUT  OUT=EHATB  P=E4HAT; 

PROC  AUTOREG  NOPRINT  DATA=EHATB; 
MODEL  EY=E1HAT  E4HAT  T   Dl  D2  D3  Ml  M2  T2  Tl; 

OUTPUT  OUT=BETAS  P=EHAT1  PARMS=G1  G4  BBl     BB3  BB4  BBS  BB6  BB7 
BBS  BB9  INTERCEPT=BBO; 

DATA  RES; 
SET  BETAS; 

ZHAT=EY  -G1*E1  -G4*E4  -BB1*T        -BB3*D1  -BB4*D2 
-BB5*D3  -BB6*M1  -BB7*M2  -BB8*T2  -BB9*T1  -BBC; 
ZHAT1=LAG(ZHAT); 
ZBAR=ACTUAL  -G1*EZ1  -G4*EZ4  -BB1*T  -BB3*D1 

-BB4*D2  -BB5*D3  -BB6*M1  -BB7*M2  -BB8*T2 

-BB9*T1  -BBC; 
ZBAR1=LAG(ZBAR); 

PROC  AUTOREG  NOPRINT  DATA=RES; 
MODEL  ZHAT=ZHAT1/N0INT; 
OUTPUT  0UT=P1  PARMS=RHO; 

PROC  AUTOREG  DATA=P1  NOPRINT; 
MODEL  FHAT=REG/NOINT; 
OUTPUT  OUT=W  PARMS=PHI; 

DATA  TRANS; 
SET  W; 

ESTAR=EY-RH0*E1; 
E1STAR=E1-RH0*LAG1(E1) 
E4STAR=E4-RH0*LAG1(E4) : 
EZSTAR=ACTUAL  -RH0*EZ1: 
EZ1STAR=EZ1  -RH0*LAG1(EZ1); 
EZ4STAR=EZ4  -RH0*LAG1(EZ4) ; 
T2STAR=T2  -RH0*LAG1(T2) ; 
T1STAR=T1  -RH0*LAG1(T1); 
TSTAR=T-RH0*(T-1); 
Ml STAR=M1-RH0*LAG1 (Ml ) 
M2STAR=M2-RH0*LAG1 (M2) ; 
D 1 STAR=D 1 -RH0*LAG 1 ( D 1 ) 
D2STAR=D2-RH0*LAG1 (D2) ; 
D3STAR=D3-RH0*LAG1 (D3)  : 
0NESTAR=1-RH0; 

PROC  AUTOREG  NOPRINT  DATA=TRANS; 

MODEL  ESTAR=E1STAR  E4STAR  TSTAR  DISTAR  D2STAR  D3STAR 

Ml STAR  M2STAR  T2STAR  TISTAR  ONESTAR  ZHATl/NOINT; 
OUTPUT  OUT=PREDICT  PARMS=GM1  GM4  Bl  B3  B4  B5  B6  B7  B8  B9  BO  DELTA  R=Z; 

DATA  Y5678; 
SET  PREDICT; 
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IF  YQ  GE   LAST; 

P=DELTA+RHO; 

Z1=LAG(Z); 

Z2=LAG2(Z); 

Z3=LAG3(Z); 

Z4=LAG4(Z); 

Z5=LAG5(Z): 

ZB=-(EZ1STAR*GM1   +EZ4STAR*GM4  +TSTAR*B1 

+D1STAR*B3   +D2STAR*B4  +D3STAR*B5   -H11STAR*B6 
+M2STAR*B7  +T2STAR*B8  +T1STAR*B9  -K)NESTAR*BO 
+ZBAR1*DELTA  -EZSTAR) ; 

ZB1=LAG(ZB); 

ZB5=LAG5(ZB); 

ZB2=-LAG2(ZB); 

ZB3=LAG3(ZB); 

ZB4=LAG4(ZB); 

PQTR1=753; 

PQTR2=754 

PQTR3=761 

PQTR4=762 

PQTR5=763 

PQTR6=764 

PQTR7=771 


DATA  B752; 

SET  Y5678; 

BASE=752; 

RETAIN  FOLD  FFOLD  PREDl  FOSOLD  FOSTl; 

IF  YQ=PQTR1  THEN  DO; 

PRW10=B0  -I-GM1*E1  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +P*Z1; 
F0STER=E4  +PHI*REG  +DEL; 
FOSOLD=FOSTER; 
F0ST1=F0STER; 
F0LD=PRW10; 
PRW11=PRW10; 
FF0LD=PRW11; 
PRED1=PRW10; 
H0RIZ0N=1; 
END; 


IF  YQ=PQTR2  THEN  DO; 

PRW10=B0  +GM1*F0LD  -)-GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 
+B6*ML  +B7*M2  +B8*T2  +B9*TI  +(P**2)*Z2; 


PRW11=B0  +GM1*FF0LD  +GM4*E4  +B1*T 
+B8*T2  +B9*(5188)  +B6*(6091 
F0STER=E4  +  PHI*(F0S0LD-E5)  +DEL; 
FOSOLD=FOSTER; 
FOLD=PRW10; 
FF0LD=PRW1 1 ; 
H0RIZ0N=2; 
END; 


+B3*D1  +B4*D2  +B5*D3 
)  +B7*(20060   )  +(P**2)*Z2; 


IF  YQ=PQTR3  THEN  DO; 
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PRWIO-BO  +GM1*F0LD  +GM4*E4  +B1*T       +B3*Dl  +BA*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**3)*Z3; 
PRW11=B0  -I-GM1*FF0LD  4<JM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1759)  +B9*(5211)  +B6*(6178   )  +B7*(20317   )  +(P**3)*Z3; 
F0STER-E4  +PHI*(F0S0LD-E5)  +DEL; 
FOSOLD=FOSTER; 
F0LD=PRW10; 
FF0LD=PRW1 1 ; 
H0RIZ0N=3; 
END; 

IF  YQ-PQTR4  THEN  DO; 

PRW10=B0  +GM1*F0LD  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**4)*Z4; 
PRW11=B0  +GM1*FF0LD  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1756)  +B9*(5233)  +B6*(6600  )  +B7*(20612   )  +(P**4)*Z4; 
F0STER=»E4  +PHI*(F0S0LD-E5)+DEL; 
FOSOLD=FOSTER; 
FOLD=PRW10; 
FF0LD=»PRW1 1 ; 
H0RIZ0N=4; 
END; 

IF  YQ=PQTR5  THEN  DO; 

PRW10=B0  +GM1*F0LD  -(-GM4*PRED1  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**5)*Z5; 
PRWll-BO  -H3M1*FF0LD  -k;M4*PRED1  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1752)  +B9*(5254)  +B6*(7014   )  +B7*(20886   )  +(P**5)*Z5; 
F0STER=F0ST1  +PHI*(F0S0LD-E5)  +(F0ST1-FIR)/A; 
H0RIZ0N=5; 
END; 
ORDER=FIRM*10000+HORIZON*1000+BASE; 

DATA  BB752; 
SET  B752; 

IF  YQ  GE  753  AND  YQ  LE  763^ 

KEEP  YQ  YEAR  QTR  HORIZON  DNUM  CNUM  FIRM  PRWIO  PRWII  FOSTER 
ACTUAL  BASE  ORDER; 


*UPDATE; 

DATA  B753; 

SET  Y5678; 

BASE=753; 

RETAIN  FOLD  FFOLD  PREDl  FOSTl  FOSOLD; 


IF  YQ=PQTR2  THEN  DO; 

PRW10=B0  +GM1*EZ1  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +P*ZB1; 
F0STER=E4  +PHI*(EZ1-E5)  +DEL; 
FOSOLD=FOSTER; 
F0ST1=F0STER; 
FOLD=PRW10; 
PRW11=PRW10; 
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FF0LD=PRW1 1 ; 
PRED1=PRW10; 
H0RIZ0N=1; 
END; 

IF  YQ=PQTR3  THEN  DO; 

PRW10=B0  -K;M1*F0LD  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**2)*ZB2; 
PRW11=B0  +GM1*FF0LD  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*T2  +B9*(5173)  +B6*(5909   )  +B7*(20098   )  +(P**2)*ZB2; 
F0STER=E4  +PHI*(F0S0LD-E5)  +DEL; 
F0S0LD=F0STER; 
FOLD=PRW10; 
FF0LD=PRW1 1 ; 
H0RIZ0N=2; 
END; 

IF  YQ=PQTR4  THEN  DO; 

PRW10=B0  +GM1*F0LD  -I-GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**3)*ZB3; 
PRW11=B0  +GM1*FF0LD  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1709)  +B9*(5191)  +B6*(6280   )  +B7*(20351   )  +(P**3)*ZB3; 
F0STER=E4  +PHI*(F0S0LD-E5)  +DEL; 
FOSOLD-FOSTER; 
FOLD=PRW10; 
FF0LD=PRW1 1 ; 
H0RIZ0N=3; 
END; 

IF  YQ=PQTR5  THEN  DO; 

PRW10=B0  +GM1*F0LD  +GM4*EZ4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**4)*ZB4; 
PRW11=B0  +GM1*FF0LD  +GM4*EZ4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1701)  +B9*(5209)  +B6*(6639   )  +B7*(20580  )  +(P**4)*ZB4; 
F0STER=EZ4  +PHI*(F0S0LD-E5)  +(EZ4-FIR)/A; 
F0S0LD=F0STER; 
F0LD=PRW10; 
FF0LD=PRW1 1 ; 
HORIZ0N=4; 
END; 

IF  YQ=PQTR6  THEN  DO; 

PRW10=B0  +GM1*F0LD  +GM4*PRED1  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**5)*ZB5; 
PRW11=B0  -K;M1*FF0LD  +GM4*PRED1  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1692)  +B9*(5227)  +B6*(6785   )  +B7*(20800   )  +(P**5)*ZB5; 
F0STER=F0ST1  +PHI*(F0S0LD-EZ5)  +(F0ST1-FIR)/A; 
H0RIZ0N=5; 
END; 
ORDER=FIRM*10000+HORIZON*1000+BASE; 


DATA  B754; 
SET  Y5678; 
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BASE=754; 

RETAIN  FOLD  FFOLD  FREDl  FOSTl  FOSOLD; 

IF  YQ=PQTR3  THEN  DO; 

PRW10=B0  +GM1*EZ1  -l-GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +P*ZB1; 
F0STER=E4  +PHI*(EZ1-E5)  +DEL; 
F0S0LD=F0STER; 
F0ST1=F0STER; 
FOLD=PRW10; 
PRW11=PRW10; 
FF0LD=PRW11; 
PRED1=PRW10; 
H0RIZ0N=1; 
END; 

IF  YQ=PQTR4  THEN  DO; 

PRW10=B0  -I-GM1*F0LD  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**2)*ZB2; 
PRW11=B0  -f€Ml*FFOLD  +GM4*E4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*T2  +B9*(5157)  +B6*(6015   )  +B7*(20149   )  +(P**2)*ZB2; 
F0STER=E4  +PHI*(F0S0LD-E5)  +DEL; 
FOSOLD=FOSTER; 
FOLD=PRW10; 
FF0LD=PRW1 1 ; 
H0RIZ0N=2; 
END; 

IF  YQ=PQTR5  THEN  DO; 

PRW10=B0  +GM1*F0LD  +GM4*EZ4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**3)*ZB3; 
PRW11=B0  +GM1*FF0LD  +GM4*EZ4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1656)  +B9*(5172)  +B6*(6325   )  +B7*(20341   )  +(P**3)*ZB3; 
F0STER=EZ4  +PHI*(F0S0LD-E5)  +(EZ4-FIR)/A; 
F0S0LD=F0STER; 
F0LD=PRW10; 
FF0LD=PRW1 1 ; 
H0RIZ0N=3; 
END; 

IF  YQ=PQTR6  THEN  DO; 

PRW10=B0  +GM1*F0LD  +GM4*EZ4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**4)*ZB4; 
PRW11=B0  +GM1*FF0LD  +GM4*EZ4  +B1*T       +B3*D1  +B4*D2  +B5*D3 

+B8*(1643)  +B9*(5186)  +B6*(6418   )  +B7*(20520   )  +(P**4)*ZB4; 
F0STER=EZ4  +PHI*(F0S0LD-EZ5)  +(EZ4-FIR)/A; 
F0S0LD=F0STER; 
FOLD=PRW10; 
FF0LD=PRW1 1 ; 
H0RIZ0N=4; 
END; 

IF  YQ=PQTR7  THEN  DO; 

PRW10=B0  +GM1*F0LD  +GM4*PRED1  +B1*T       +B3*D1  +B4*D2  +B5*D3 
+B6*M1  +B7*M2  +B8*T2  +B9*T1  +(P**5)*ZB5; 
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PRW11=B0  +GM1*FF0LD  -I-GM4*PRED1   +B1*T  +B3*D1   +B4*D2  +B5*D3 

+B8*(1360)  +B9*(5200)   +B6*(6544      )  +B7*(20715      )  +(P**5)*ZB5; 
F0STER=F0ST1   +PHI*(F0S0LD-EZ5)   +(F0ST1-FIR)/A; 
H0RIZ0N=5; 
END; 
ORDER=FIRM*1000(>fHORIZON*1000+BASE; 


DATA  BB753; 

SET  B753; 

IF  YQ  GE  754  AND  YQ  LE  764; 

KEEP  YQ  YEAR  QTR  HORIZON  DNUM  CNUM  FIRM  PRWIO  PRWll  FOSTER 

ACTUAL  BASE  ORDER; 
DATA  BB754; 
SET  B754; 

IF  YQ  GE  761  AND  YQ  LE  771; 
KEEP  YQ  YEAR  QTR  HORIZON  DNUM  CNUM  FIRM  PRWIO  PRWll  FOSTER 

ACTUAL  BASE  ORDER; 


%  MACRO 
%  MACRO 


DATA  DEAD; 

SET  DEAD  BB752  BB753  BB754; 

% 

MACRO  COMNUM  118745  %  MACRO 

MACRO  COMNUM  218534  %   MACRO 

MACRO  COMNUM  260003  %  MACRO 

MACRO  COMNUM  291210  %  MACRO 

MACRO  COMNUM  300587  %  MACRO 

MACRO  COMNUM  481196 

MACRO  COMNUM  524462 

MACRO  COMNUM  540210  %  MACRO 

MACRO  COMNUM  582562  %  MACRO 

MACRO  COMNUM  597715  %  MACRO 

MACRO  COMNUM  651186  %  MACRO 

MACRO  COMNUM  682063  Z   MACRO 

MACRO  COMNUM  772786  %  MACRO 

DATA  GOOD; 

SET  DEAD; 

IF  YQ  NE  222; 

DATA  QTRS.FINALQ; 

SET  QTRS.FINALQ  GOOD; 

PROC  PRINT  DATA=QTRS.FINALQ; 

TITLE  QUARTERLY  RESULTS  FOR 

/*EOJ 


COMP 
COMP 
COMP 
COMP 
COMP 
COMP 
COMP 
COMP 
COMP 
COMP 
COMP 
COMP 
COMP 


26  % 

39  % 

40  % 

41  % 

42  % 

44  % 

45  % 

46  % 

47  % 

48  % 

49  Z 

50  % 
52  % 


PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 
PROGRAM 


ALL  NON-B-J  MODELS; 
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